cedricrupb / code_tokenizeLinks
Fast tokenization and structural analysis of any programming language
☆59Updated 9 months ago
Alternatives and similar repositories for code_tokenize
Users that are interested in code_tokenize are comparing it to the libraries listed below
Sorting:
- A toolkit for pre-processing large source code corpora☆47Updated 3 years ago
- Mining tool and large-scale datasets of single statement bug fixes in Python☆18Updated last year
- Extract and combine multiple source code views using tree-sitter☆153Updated last month
- ManyTypes4Py: A benchmark Python dataset for machine learning-based type inference☆24Updated 3 years ago
- Seq2seq Type Inference using Static Analysis and CodeT5☆32Updated 2 years ago
- The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…☆22Updated 5 years ago
- ☆68Updated 3 years ago
- Data and Code for Reproducing "Global Relational Models of Source Code"☆84Updated 4 years ago
- PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…☆87Updated 3 years ago
- Type4Py: Deep Similarity Learning-Based Type Inference for Python☆65Updated 2 years ago
- Set of tools to help working with "Big Code"☆43Updated 3 years ago
- code for "Implant Global and Local Hierarchy Information to Sequence based Code Representation Models"☆12Updated 10 months ago
- Fast AST based code differencing in Python☆34Updated 9 months ago
- Fast and robust AST parsing of any language☆55Updated 9 months ago
- Contains the code and data for our #ICSE2022 paper titled as "CodeFill: Multi-token Code Completion by Jointly Learning from Structure an…☆15Updated 3 years ago
- Contains the code for our ICSE 2020 paper: Big Code != Big Vocabulary: Open-Vocabulary Language Models for Source Code and for its earlie…☆84Updated 2 years ago
- A collection of recent papers, benchmarks and datasets of AI4Code domain.☆58Updated last year
- ☆146Updated 5 months ago
- Implementation of the paper "Language-agnostic representation learning of source code from structure and context".☆171Updated 3 years ago
- The RunBugRun dataset of executable bugs☆23Updated last month
- We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of e…☆24Updated 3 years ago
- Learning to Update Natural Language Comments Based on Code Changes: Artifact☆33Updated 5 years ago
- CoditT5: Pretraining for Source Code and Natural Language Editing☆28Updated 9 months ago
- ☆13Updated 2 years ago
- Replication Code for "Self-Supervised Bug Detection and Repair" NeurIPS 2021☆111Updated 3 years ago
- TensorFlow code for the neural network presented in the paper: "Structural Language Models of Code" (ICML'2020)☆90Updated 3 years ago
- Recent Advances in Programming Language Pre-Trained Models (PL-PTMs)☆59Updated 3 years ago
- Code for the paper "A Structural Model for Contextual Code Changes"☆32Updated 2 years ago
- Hoppity☆60Updated 4 years ago
- Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.☆58Updated last year