yigitkonur / data-preparation-for-fine-tuning
A Python project for preparing and analyzing datasets from JSONL files. It includes tools for shuffling, categorizing, and generating reports on dataset content.
☆14Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for data-preparation-for-fine-tuning
- Python script for automated clustering of embeddings with DBSCAN, using cosine similarity for flexible, size-agnostic grouping (I hate K-…☆8Updated 9 months ago
- A high-performance Rust tool for sending API requests (to LLMs in my case) with built-in weighted load balancing, retry mechanisms, and r…☆14Updated 5 months ago
- A repository trying to translate subtitles with GPT 3.5 Turbo without losing context (using the dynamic window context method).☆29Updated last year
- Server load testing CLI tool 🏋️☆10Updated last year
- Serverless API Gateway☆62Updated this week
- It serves to visualize the muninn configs you have prepared.☆21Updated 2 years ago
- a lightweight and simple cli package☆13Updated 2 years ago
- A tool that finds related serp results for the given input.☆10Updated 4 years ago
- Spotify Web API wrapper for Cloudflare Workers☆18Updated last year
- Binalyze logger is an easily customizable wrapper for logrus with log rotation☆28Updated 3 years ago
- Tiny AI is a platform to create/modify AI powered chatbots. This repository contains ChatGPT plugin and API for talk, create and modify T…☆34Updated 5 months ago
- Go-based task queue with MongoDB storage for distributed app tasks☆14Updated 7 months ago
- 📮 Lightweight, high performance and configurable API rate limiter.☆14Updated 3 years ago
- An example repository of using the Twirp RPC framework with Go☆33Updated 2 years ago
- Hızlıca Regex öğrenebileceğiniz pratik bir eğitim.☆10Updated 3 years ago
- Kubernetes logs to MongoDB☆16Updated 2 years ago
- Basic CLI for format Json, HTML and XML Yaml!☆32Updated 5 months ago
- Serverless Server Side Rendering with AWS CDK and Next.js☆24Updated 3 years ago
- httpreq is an http request library written with golang to make requests easily and handle responses gracefully.☆57Updated 10 months ago
- Developer's Helper to Docker, Kubernetes, and Terraform. Fully automatic, without any config or question 🙌☆79Updated 3 years ago
- Muninn is a fast and flexible HTML parsing tool that simplifies the process of extracting data from HTMLs.☆136Updated 7 months ago
- Making homepage clone example of wope.com site with Angular framework.☆10Updated last year
- Summarize webpages from specified URLs using the LangChain framework and the ChatOllama model☆101Updated last month
- Lyrics and translations for currently playing song in your Spotify account.☆103Updated last year
- Ekşi Sözlük API☆9Updated 2 years ago
- Idiomatic way to fill structs with options logic☆13Updated 2 years ago
- Self-Driven Autonomous Python Libraries☆93Updated 2 weeks ago
- Multi cluster kubernetes dashboard with batteries included. Build by developers, for developers.☆34Updated 3 years ago
- ☆12Updated this week