cedricrupb / code_tokenize
Fast tokenization and structural analysis of any programming language
☆55Updated 2 months ago
Alternatives and similar repositories for code_tokenize:
Users that are interested in code_tokenize are comparing it to the libraries listed below
- Fast and robust AST parsing of any language☆37Updated 2 months ago
- PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…☆87Updated 2 years ago
- Fast AST based code differencing in Python☆33Updated 2 months ago
- Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.☆53Updated 7 months ago
- Probing pre-trained source code models☆15Updated 2 years ago
- Type4Py: Deep Similarity Learning-Based Type Inference for Python☆62Updated last year
- BugsInPy: Benchmarking Bugs in Python Projects☆93Updated 8 months ago
- Extract and combine multiple source code views using tree-sitter☆126Updated 3 months ago
- A toolkit for pre-processing large source code corpora☆47Updated 2 years ago
- Seq2seq Type Inference using Static Analysis and CodeT5☆30Updated last year
- Mining tool and large-scale datasets of single statement bug fixes in Python☆16Updated last year
- Data and Code for Reproducing "Global Relational Models of Source Code"☆83Updated 3 years ago
- ☆16Updated last year
- Code for "StructCoder: Structure-Aware Transformer for Code Generation"☆71Updated last year
- ManyTypes4Py: A benchmark Python dataset for machine learning-based type inference☆22Updated 3 years ago
- CoditT5: Pretraining for Source Code and Natural Language Editing☆28Updated 2 months ago
- The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…☆22Updated 4 years ago
- Neural Code Translator provides instructions, datasets, and a deep learning infrastructure (based on seq2seq) that aims at learning code …☆38Updated 5 years ago
- ☆28Updated last year
- Contrastive Code Representation Learning: functionality-based JavaScript embeddings through self-supervised learning☆165Updated 3 years ago
- ☆42Updated last month
- The RunBugRun dataset of executable bugs☆23Updated last year
- A tool to provide the graph representation of the source code based on the paper: "Learning to Represent Program with Graph, ICLR'18"☆48Updated 4 years ago
- Source Code Data Augmentation for Deep Learning: A Survey.☆64Updated 9 months ago
- TeCo: an ML+Execution model for test completion☆31Updated 9 months ago
- Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"☆52Updated last year
- Utilities used by the Deep Program Understanding team☆102Updated last year
- TensorFlow code for the neural network presented in the paper: "Structural Language Models of Code" (ICML'2020)☆88Updated 2 years ago
- ☆132Updated 4 months ago
- This is the tool released in ICSE 2022 paper "Static Inference Meets Deep Learning: A Hybrid Type Inference Approach for Python"☆42Updated last year