Fast tokenization and structural analysis of any programming language
☆62Jan 14, 2025Updated last year
Alternatives and similar repositories for code_tokenize
Users that are interested in code_tokenize are comparing it to the libraries listed below
Sorting:
- Fast and robust AST parsing of any language☆65Nov 11, 2025Updated 3 months ago
- Fast AST based code differencing in Python☆44Jan 31, 2026Updated 3 weeks ago
- ESEC/FSE'21: Prediction-Preserving Program Simplification☆10Oct 4, 2022Updated 3 years ago
- MODIT: On Multi-Modal Learning of Editing Source Code.☆20Apr 24, 2021Updated 4 years ago
- Generating Adversarial Examples for Holding Robustness of Source Code Processing Models☆14Dec 2, 2021Updated 4 years ago
- Code Generation as a Dual Task of Code Summarization.☆30Jun 28, 2021Updated 4 years ago
- Official repository for the paper "GN-Transformer: Fusing AST and Source Code information in Graph Networks".☆17May 25, 2025Updated 9 months ago
- ☆13Jul 6, 2023Updated 2 years ago
- Source codes for paper ”ReACC: A Retrieval-Augmented Code Completion Framework“☆65Apr 18, 2022Updated 3 years ago
- A large dataset of 4.2m Java source code and parallel data of their description from code search, and code summarization studies.☆15Feb 24, 2022Updated 4 years ago
- BGraph is a tool designed to generate dependencies graphs from Android.bp soong files.☆20Sep 19, 2025Updated 5 months ago
- Set of tools to help working with "Big Code"☆42Apr 28, 2022Updated 3 years ago
- Program Translator AI built on Pytorch☆15Dec 19, 2019Updated 6 years ago
- Mining tool and large-scale datasets of single statement bug fixes in Python☆19Nov 29, 2023Updated 2 years ago
- Sample code for 3rd party developers working on Android On Snapdragon☆12Sep 4, 2024Updated last year
- IST'21 & SANER'22: Semantic-Preserving Program Transformations☆31Oct 25, 2022Updated 3 years ago
- The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…☆22Aug 19, 2020Updated 5 years ago
- ☆41Jan 13, 2023Updated 3 years ago
- ☆24Jun 17, 2021Updated 4 years ago
- ☆23Aug 6, 2020Updated 5 years ago
- Replication package of the ICSE2025 paper titled "Leveraging Large Language Models for Enhancing the Understandability of Generated Unit …☆11Feb 19, 2025Updated last year
- Monitor and Control how Android Apps access your local storage. A great tool to investigate what files your apps put their eyes on.☆10Feb 5, 2024Updated 2 years ago
- Stuff related to scraping the Code Review StackExchange☆12Jan 19, 2023Updated 3 years ago
- Artifact repository for the paper "Perfect Is the Enemy of Test Oracle", In Proceedings of The 30th ACM Joint European Software Engineeri…☆11May 4, 2023Updated 2 years ago
- This project provides several implementations for commit untangling and proposes a new representation of git patches by projecting the pa…☆11Jul 28, 2025Updated 6 months ago
- ARC4 (Alleged RC4) cryptography provider class library.☆10Dec 15, 2024Updated last year
- 📱 RUNIC tamper detection demo - designed to serve as a parallel for understanding more complex tamper detection and integrity systems su…☆15Apr 13, 2024Updated last year
- This repo is the benchmark for source code summarization on C language☆26Mar 18, 2021Updated 4 years ago
- SMI230 sensor android hal☆13Mar 20, 2025Updated 11 months ago
- Information about the CodedotAI reading group sessions.☆12Aug 16, 2021Updated 4 years ago
- ☆12Feb 28, 2025Updated 11 months ago
- ☆10Oct 1, 2023Updated 2 years ago
- TDCleaner: A Tool for Detecting Obsolete TODO Comments in Software Repos☆12Dec 9, 2021Updated 4 years ago
- Tool Collection for AOSP and AAOS builds☆14Apr 15, 2025Updated 10 months ago
- Program Transformation Tool for Java Methods☆11Sep 16, 2022Updated 3 years ago
- ☆12Mar 22, 2024Updated last year
- Code for Unsupervised Domain Adaptation of a Pretrained Cross-Lingual Language Model, IJCAI 2020☆12Nov 26, 2020Updated 5 years ago
- repo for the paper titled “CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation”☆14Oct 4, 2023Updated 2 years ago
- [AAAI 2021] - TreeCaps: Tree-based Capsule Network for Source Code Processing☆23Mar 24, 2023Updated 2 years ago