Setu is a comprehensive pipeline designed to clean, filter, and deduplicate diverse data sources including Web, PDF, and Speech data. Built on Apache Spark, Setu encompasses four key stages: document preparation, document cleaning and analysis, flagging and filtering, and deduplication.
☆17May 17, 2024Updated 2 years ago
Alternatives and similar repositories for setu
Users that are interested in setu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM Workshop at Data Hack Summit 2023☆14Aug 4, 2023Updated 3 years ago
- ☆13Oct 20, 2022Updated 3 years ago
- ☆25Apr 23, 2025Updated last year
- The repository for ACL 2024 paper "TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models"☆37Jun 29, 2024Updated 2 years ago
- An open source in memory Graph Database for Social Networks☆10Sep 20, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for the paper "HALoGEN: Fantastic LLM Hallucinations and Where To Find Them"☆30May 18, 2025Updated last year
- A simple sniffer for NATS, the cloud native messaging system. https://nats.io☆11Feb 15, 2016Updated 10 years ago
- Golang news aggregator mobile application written in React Native (source:www.golangnews.com)☆13Jun 23, 2026Updated 3 months ago
- Augmented Dickey-Fuller implementation in Go☆12Mar 15, 2019Updated 7 years ago
- The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/☆29Oct 8, 2024Updated 2 years ago
- A Background Task Manager built on top of NATS.io☆12Aug 19, 2026Updated last month
- Task management for AI agents☆16Jun 25, 2025Updated last year
- Plivo github actions☆14Nov 29, 2022Updated 3 years ago
- A Go client to receive real-time data messages from Polymarket☆12Jun 25, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The good old times are coming back with PACMAN☆12Jun 12, 2024Updated 2 years ago
- Toolbox for Binance Go connector☆15Apr 28, 2023Updated 3 years ago
- go-active-learning is a command line annotation tool for binary classification problem written in Go.☆15Apr 3, 2021Updated 5 years ago
- livegollection is a Golang library for live data synchronization between backend and frontend of a custom user-implemented collection. It…☆23Feb 18, 2022Updated 4 years ago
- Annotated corpus + evaluation metrics for text anonymisation☆81Jan 19, 2026Updated 8 months ago
- Automated content cross posting from Notion Database to Dev.to, Hashnode, Medium, Twitter, and LinkedIn using GitHub Actions.☆14Oct 21, 2024Updated last year
- 摸鱼派聊天室python客户端 ｜🥷 账号多开 ｜💗免密登陆 ｜ ❤️丰富的快捷命令 ｜🌈自定义字体颜色 ｜🧧 红包脚本 ｜ 配置导出☆10May 7, 2025Updated last year
- Parr(B)ot is a Telegram bot framework based on top of Echotron☆10Jan 15, 2023Updated 3 years ago
- Exercise files for the course Advanced Form Component with VueJs☆11Feb 2, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Mar 20, 2023Updated 3 years ago
- One command automated macOS/Linux laptop/VM/container bootstrapper.☆19Oct 5, 2026Updated last week
- Jonas Schmedtmann - The Complete JavaScript Course 2018☆12Jan 21, 2019Updated 7 years ago
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 10 months ago
- The Complete Blockchain Professional Course, published by Packt☆10Jan 30, 2023Updated 3 years ago
- ☆11Aug 22, 2023Updated 3 years ago
- Cockatrice is a full text search and indexing server. It is written in Python built on top of Whoosh.☆17Sep 27, 2019Updated 7 years ago
- ☆10Oct 2, 2024Updated 2 years ago
- Say goodbye to OTPs and hello to a secure & seamless login experience.☆10Feb 12, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆53May 2, 2021Updated 5 years ago
- A simple crypto Telegram Bot based on chart-img.com API. The bot replies to the user with a screenshot of crypto market charts.☆11Mar 31, 2023Updated 3 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆14Sep 28, 2024Updated 2 years ago
- Custom tools for agent based crewAI langchain solutions☆10May 27, 2024Updated 2 years ago
- Real-Time Open-Vocabulary Object Detection☆12Feb 7, 2024Updated 2 years ago
- ☆12Jun 6, 2018Updated 8 years ago
- Demo App☆12Jan 27, 2026Updated 8 months ago