cedricrupb / code_tokenizeLinks
Fast tokenization and structural analysis of any programming language
☆56Updated 4 months ago
Alternatives and similar repositories for code_tokenize
Users that are interested in code_tokenize are comparing it to the libraries listed below
Sorting:
- Fast and robust AST parsing of any language☆41Updated 4 months ago
- Fast AST based code differencing in Python☆34Updated 4 months ago
- PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…☆88Updated 3 years ago
- Extract and combine multiple source code views using tree-sitter☆140Updated 3 weeks ago
- ☆66Updated 3 years ago
- A toolkit for pre-processing large source code corpora☆47Updated 2 years ago
- Type4Py: Deep Similarity Learning-Based Type Inference for Python☆63Updated last year
- Code for the paper "A Structural Model for Contextual Code Changes"☆32Updated last year
- Data and Code for Reproducing "Global Relational Models of Source Code"☆84Updated 4 years ago
- Seq2seq Type Inference using Static Analysis and CodeT5☆31Updated last year
- Program analysis tools built on tree-sitter (https://github.com/tree-sitter/tree-sitter).☆42Updated last year
- ☆16Updated 8 months ago
- ManyTypes4Py: A benchmark Python dataset for machine learning-based type inference☆23Updated 3 years ago
- Recent Advances in Programming Language Pre-Trained Models (PL-PTMs)☆58Updated 3 years ago
- CoditT5: Pretraining for Source Code and Natural Language Editing☆28Updated 4 months ago
- Mining tool and large-scale datasets of single statement bug fixes in Python☆17Updated last year
- ☆138Updated last week
- Source Code Data Augmentation for Deep Learning: A Survey.☆64Updated 11 months ago
- Probing pre-trained source code models☆15Updated 3 years ago
- an implementation of "code2vec: Learning Distributed Representations of Code"☆30Updated 10 months ago
- A Typescript library for parsing Python 3 and doing basic program analysis, like forming control-flow graphs and def-use chains.☆53Updated 5 years ago
- Learning to Update Natural Language Comments Based on Code Changes: Artifact☆33Updated 4 years ago
- A collection of recent papers, benchmarks and datasets of AI4Code domain.☆57Updated last year
- Replication Package for "Compressing Pre-trained Models of Code into 3 MB", ASE 2022☆29Updated 7 months ago
- MODIT: On Multi-Modal Learning of Editing Source Code.☆20Updated 4 years ago
- ☆20Updated 2 years ago
- Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.☆54Updated 10 months ago
- ☆43Updated 3 months ago
- Neural Code Translator provides instructions, datasets, and a deep learning infrastructure (based on seq2seq) that aims at learning code …☆38Updated 6 years ago
- Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"☆53Updated last year