jehumtine / synthetic_data_generatorLinks
This script is designed to convert bodies of text into a question and answer JSON format using the GPT-4 language model. The process involves extracting text from PDF files, tokenizing the text, generating questions and answers, and then saving the results in a JSON file.
☆24Updated 2 years ago
Alternatives and similar repositories for synthetic_data_generator
Users that are interested in synthetic_data_generator are comparing it to the libraries listed below
Sorting:
- ☆37Updated last year
- Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.☆48Updated last year
- This repository holds enhanced Agents, built for the Microsoft AutoGen Framework. Debuting with a MemoryEnabledAgent with improvements in…☆117Updated 2 years ago
- Python Streamlit web app utilizing OpenAI (GPT4) and LangChain LLM tools with access to Wikipedia, DuckDuckgo Search, and a ChromaDB with…☆73Updated 2 years ago
- Agent with vision ability via llava & autogen☆73Updated 2 years ago
- ☆138Updated 2 years ago
- DocumentGPT is a web application that allows you to chat over your research document using OpenAI's chat API and perform semantic search …☆121Updated 2 years ago
- OpenAI functions + Chainlit + Streaming responses. Chain multiple functions in one query.☆33Updated 2 years ago
- This repository demonstrates how a simple memory file can be incorporated into an Agents routine using the AutoGen framework.☆50Updated 2 years ago
- LLM Siri with OpenAI, Perplexity, Ollama, Llama2, Mistral, Mixtral & Langchain☆62Updated 2 years ago
- This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query☆103Updated 2 years ago
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆103Updated last year
- 🌟PolyGPT: An Overview of Agent-Based System Architecture for Autonomous Business Operations☆85Updated last year
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆71Updated last year
- A chat interface that uses the REMO memory system with LangFlow☆123Updated 2 years ago
- ☆41Updated 2 years ago
- RestAI's Frontend☆20Updated 4 months ago
- This is a User Interface built for Autogen using ChainLit.☆120Updated last year
- Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.☆65Updated 2 years ago
- Scrape Webpages with AI Vision☆50Updated 2 years ago
- ☆56Updated last year
- Python library and CLI for AI tools☆63Updated 2 years ago
- ☆60Updated 2 years ago
- Using Langroid's Multi-Agent Framework to Build LLM Apps☆147Updated 6 months ago
- Experiments with open source LLMs☆74Updated last week
- I have explained how to create superior RAG pipeline for complex pdfs using LlamaParse. We can extract text and tables from pdf and QA on…☆49Updated last year
- ☆55Updated 4 months ago
- ☆47Updated last year
- An LLM GUI application; enables you to interact with your files, offering dynamic parameters that can modify response behavior during run…☆95Updated 2 months ago
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated 2 years ago