Alternatives and similar repositories for code_tokenize

Users that are interested in code_tokenize are comparing it to the libraries listed below

• cedricrupb / code_ast
  Fast and robust AST parsing of any language
  ☆41Updated 4 months ago
• cedricrupb / code_diff
  Fast AST based code differencing in Python
  ☆34Updated 4 months ago
• google-research / plur
  PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…
  ☆88Updated 3 years ago
• IBM / tree-sitter-codeviews
  Extract and combine multiple source code views using tree-sitter
  ☆140Updated 3 weeks ago
• eth-sri / TFix
  ☆66Updated 3 years ago
• giganticode / codeprep
  A toolkit for pre-processing large source code corpora
  ☆47Updated 2 years ago
• saltudelft / type4py
  Type4Py: Deep Similarity Learning-Based Type Inference for Python
  ☆63Updated last year
• tech-srl / c3po
  Code for the paper "A Structural Model for Contextual Code Changes"
  ☆32Updated last year
• VHellendoorn / ICLR20-Great
  Data and Code for Reproducing "Global Relational Models of Source Code"
  ☆84Updated 4 years ago
• utopia-group / TypeT5
  Seq2seq Type Inference using Static Analysis and CodeT5
  ☆31Updated last year
• bstee615 / tree-climber
  Program analysis tools built on tree-sitter (https://github.com/tree-sitter/tree-sitter).
  ☆42Updated last year
• eth-sri / learning-real-bug-detector
  ☆16Updated 8 months ago
• saltudelft / many-types-4-py-dataset
  ManyTypes4Py: A benchmark Python dataset for machine learning-based type inference
  ☆23Updated 3 years ago
• yuewang-cuhk / awesome-programming-language-pretraining-papers
  Recent Advances in Programming Language Pre-Trained Models (PL-PTMs)
  ☆58Updated 3 years ago
• EngineeringSoftware / CoditT5
  CoditT5: Pretraining for Source Code and Natural Language Editing
  ☆28Updated 4 months ago
• cedricrupb / TSSB3M
  Mining tool and large-scale datasets of single statement bug fixes in Python
  ☆17Updated last year
• microsoft / codamosa
  ☆138Updated last week
• terryyz / DataAug4Code
  Source Code Data Augmentation for Deep Learning: A Survey.
  ☆64Updated 11 months ago
• giganticode / probes
  Probing pre-trained source code models
  ☆15Updated 3 years ago
• sonoisa / code2vec
  an implementation of "code2vec: Learning Distributed Representations of Code"
  ☆30Updated 10 months ago
• microsoft / python-program-analysis
  A Typescript library for parsing Python 3 and doing basic program analysis, like forming control-flow graphs and def-use chains.
  ☆53Updated 5 years ago
• panthap2 / LearningToUpdateNLComments
  Learning to Update Natural Language Comments Based on Code Changes: Artifact
  ☆33Updated 4 years ago
• bdqnghi / awesome-ai4code
  A collection of recent papers, benchmarks and datasets of AI4Code domain.
  ☆57Updated last year
• soarsmu / Compressor
  Replication Package for "Compressing Pre-trained Models of Code into 3 MB", ASE 2022
  ☆29Updated 7 months ago
• modit-team / MODIT
  MODIT: On Multi-Modal Learning of Editing Source Code.
  ☆20Updated 4 years ago
• zwzhang44 / DietCode
  ☆20Updated 2 years ago
• wasiahmad / AVATAR
  Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.
  ☆54Updated 10 months ago
• rizwan09 / REDCODER
  ☆43Updated 3 months ago
• micheletufano / NeuralCodeTranslator
  Neural Code Translator provides instructions, datasets, and a deep learning infrastructure (based on seq2seq) that aims at learning code …
  ☆38Updated 6 years ago
• amazon-science / recode
  Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"
  ☆53Updated last year