Alternatives and similar repositories for code_tokenize:

Users that are interested in code_tokenize are comparing it to the libraries listed below

• cedricrupb / code_ast
  Fast and robust AST parsing of any language
  ☆38Updated 3 months ago
• jianguda / mrncs
  ☆23Updated 2 years ago
• tech-srl / c3po
  Code for the paper "A Structural Model for Contextual Code Changes"
  ☆31Updated last year
• google-research / plur
  PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…
  ☆88Updated 3 years ago
• utopia-group / TypeT5
  Seq2seq Type Inference using Static Analysis and CodeT5
  ☆31Updated last year
• cedricrupb / code_diff
  Fast AST based code differencing in Python
  ☆33Updated 3 months ago
• giganticode / codeprep
  A toolkit for pre-processing large source code corpora
  ☆47Updated 2 years ago
• rizwan09 / REDCODER
  ☆42Updated 2 months ago
• amazon-science / recode
  Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"
  ☆52Updated last year
• cedricrupb / TSSB3M
  Mining tool and large-scale datasets of single statement bug fixes in Python
  ☆16Updated last year
• reddy-lab-code-research / StructCoder
  Code for "StructCoder: Structure-Aware Transformer for Code Generation"
  ☆73Updated last year
• yuewang-cuhk / awesome-programming-language-pretraining-papers
  Recent Advances in Programming Language Pre-Trained Models (PL-PTMs)
  ☆58Updated 3 years ago
• bdqnghi / graph-ast
  A tool to provide the graph representation of the source code based on the paper: "Learning to Represent Program with Graph, ICLR'18"
  ☆48Updated 4 years ago
• waingram / code-embeddings
  A Comparative Study of Various Code Embeddings in Software Semantic Matching
  ☆15Updated 2 years ago
• modit-team / MODIT
  MODIT: On Multi-Modal Learning of Editing Source Code.
  ☆20Updated 4 years ago
• VHellendoorn / ICLR20-Great
  Data and Code for Reproducing "Global Relational Models of Source Code"
  ☆84Updated 3 years ago
• terryyz / DataAug4Code
  Source Code Data Augmentation for Deep Learning: A Survey.
  ☆64Updated 10 months ago
• IBM / TDD-Bench-Verified
  TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)
  ☆15Updated last month
• zysszy / TreeGen-Pytorch
  ☆17Updated 2 years ago
• wasiahmad / AVATAR
  Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.
  ☆53Updated 8 months ago
• WM-SEMERU / ACER
  ACER is an AST-based Callgraph Generator Development Framework
  ☆32Updated 10 months ago
• saltudelft / codefill
  Contains the code and data for our #ICSE2022 paper titled as "CodeFill: Multi-token Code Completion by Jointly Learning from Structure an…
  ☆15Updated 2 years ago
• mahimanzum / FixEval
  We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of e…
  ☆23Updated 2 years ago
• DeepSoftwareAnalytics / CommitMsgEmpirical
  ☆28Updated 2 years ago
• google-research-datasets / great
  The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…
  ☆22Updated 4 years ago
• IBM / tree-sitter-codeviews
  Extract and combine multiple source code views using tree-sitter
  ☆132Updated 4 months ago
• wangdeze18 / Multilingual-Adapter-for-SE
  ☆17Updated 2 years ago
• JohnnyPeng18 / HiTyper
  This is the tool released in ICSE 2022 paper "Static Inference Meets Deep Learning: A Hybrid Type Inference Approach for Python"
  ☆43Updated last year
• shrivastavadisha / repo_level_prompt_generation
  ☆124Updated 2 years ago
• saikat107 / Codit
  ☆13Updated last year