dspinellis / tokenizer
Convert source code into numerical tokens
☆64Updated last year
Related projects ⓘ
Alternatives and complementary repositories for tokenizer
- ☆54Updated 11 months ago
- Sequence-to-Sequence Learning for End-to-End Program Repair (IEEE TSE 2019). Open-science repo. http://arxiv.org/pdf/1901.01808☆81Updated last year
- Deep learning code semantic similarity☆60Updated 5 years ago
- ☆16Updated 5 years ago
- ☆49Updated last year
- mwcvitkovic / Open-Vocabulary-Learning-on-Source-Code-with-a-Graph-Structured-Cache--Code-PreprocessorLibrary for preprocessing java source code into Augmented ASTs, as per the paper Open Vocabulary Learning on Source Code with a Graph-Str…☆22Updated 6 years ago
- A set of tools for extracting tokens and ASTs from code☆22Updated 6 years ago
- ☆110Updated 2 years ago
- Probabilistic API Mining☆53Updated 6 years ago
- Implementation of "Automatic Source Code Summarization with Extended Tree-LSTM"☆36Updated last year
- Smelling smells using Deep Learning☆44Updated 3 years ago
- Contains the code for our ICSE 2020 paper: Big Code != Big Vocabulary: Open-Vocabulary Language Models for Source Code and for its earlie…☆83Updated last year
- MLonCode community effort to implement Learning Distributed Representations of Code (https://arxiv.org/pdf/1803.09473.pdf)☆40Updated 6 years ago
- Implementation of 'A Convolutional Attention Network for Extreme Summarization of Source Code' in PyTorch using TorchText☆13Updated 6 years ago
- ☆45Updated 2 years ago
- Description: We want to create a deep Neural Network that can automatically generate comments for code snippets passed to it. The motiva…☆44Updated 2 years ago
- an implementation of "code2vec: Learning Distributed Representations of Code"☆29Updated 4 months ago
- Pyc-cfg is a pure python control flow graph builder for almost all Ansi C programming language.☆52Updated 6 years ago
- ☆25Updated 3 years ago
- A toolkit for pre-processing large source code corpora☆46Updated 2 years ago
- AutoenCODE is a Deep Learning infrastructure that allows to encode source code fragments into vector representations, which can be used t…☆60Updated 6 years ago
- A tool to provide the graph representation of the source code based on the paper: "Learning to Represent Program with Graph, ICLR'18"☆46Updated 4 years ago
- AVATAR: Fixing Semantic Bugs with Fix Patterns of Static Analysis Violations☆25Updated 3 years ago
- Data and Code for Reproducing "Global Relational Models of Source Code"☆83Updated 3 years ago
- A javac plugin for extracting a feature graph for plugging in to machine learning models☆27Updated 3 years ago
- Your library for dynamic language modeling☆67Updated 6 years ago
- A PyTorch implementation of `code2vec: Learning Distributed Representations of Code` (Alon et al., 2018)☆35Updated 5 years ago
- Set of tools to help working with "Big Code"☆43Updated 2 years ago
- cppminer produces a code2seq compatible datasets from C++ code bases.☆23Updated 4 years ago
- Repository for Deep API Learning (DeepAPI)☆54Updated 2 years ago