Alternatives and similar repositories for code_tokenize:

Users that are interested in code_tokenize are comparing it to the libraries listed below

• cedricrupb / code_ast
  Fast and robust AST parsing of any language
  ☆33Updated 2 weeks ago
• cedricrupb / code_diff
  Fast AST based code differencing in Python
  ☆32Updated 2 weeks ago
• cedricrupb / TSSB3M
  Mining tool and large-scale datasets of single statement bug fixes in Python
  ☆15Updated last year
• google-research-datasets / great
  The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…
  ☆22Updated 4 years ago
• shrivastavadisha / repo_level_prompt_generation
  ☆121Updated last year
• FSoft-AI4Code / CodeText-parser
  ⚒️ Tree-sitter custom toolkit for extracting function and class from raw source file
  ☆44Updated 6 months ago
• giganticode / codeprep
  A toolkit for pre-processing large source code corpora
  ☆46Updated 2 years ago
• bdqnghi / graph-ast
  A tool to provide the graph representation of the source code based on the paper: "Learning to Represent Program with Graph, ICLR'18"
  ☆47Updated 4 years ago
• VHellendoorn / ICLR20-Great
  Data and Code for Reproducing "Global Relational Models of Source Code"
  ☆83Updated 3 years ago
• IBM / tree-sitter-codeviews
  Extract and combine multiple source code views using tree-sitter
  ☆117Updated last month
• eth-sri / TFix
  ☆66Updated 2 years ago
• bstee615 / tree-climber
  Program analysis tools built on tree-sitter (https://github.com/tree-sitter/tree-sitter).
  ☆39Updated 10 months ago
• modit-team / MODIT
  MODIT: On Multi-Modal Learning of Editing Source Code.
  ☆20Updated 3 years ago
• zhangzwwww / DietCode
  ☆20Updated last year
• nus-apr / cerberus
  Research Acceleration Platform that provides interface to multiple state-of-the-art program analysis tools including but not limited to f…
  ☆67Updated 2 months ago
• google-research / plur
  PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…
  ☆87Updated 2 years ago
• subercui / CodeExp
  ☆16Updated 2 years ago
• eth-sri / learning-real-bug-detector
  ☆16Updated 3 months ago
• saikat107 / Codit
  ☆13Updated last year
• reddy-lab-code-research / StructCoder
  Code for "StructCoder: Structure-Aware Transformer for Code Generation"
  ☆70Updated last year
• jingkai92 / learning-program-representation
  ☆33Updated 2 years ago
• reddy-lab-code-research / XLCoST
  Code and data for XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence
  ☆66Updated last week
• wangdeze18 / Multilingual-Adapter-for-SE
  ☆17Updated 2 years ago
• utopia-group / TypeT5
  Seq2seq Type Inference using Static Analysis and CodeT5
  ☆30Updated last year
• sola-st / RepairAgent
  RepairAgent is an autonomous LLM-based agent for software repair.
  ☆27Updated this week
• soarsmu / BugsInPy
  BugsInPy: Benchmarking Bugs in Python Projects
  ☆85Updated 6 months ago
• giganticode / run_bug_run
  The RunBugRun dataset of executable bugs
  ☆23Updated last year
• google-deepmind / codesembench
  ☆16Updated 10 months ago
• giganticode / probes
  Probing pre-trained source code models
  ☆15Updated 2 years ago
• tech-srl / slm-code-generation
  TensorFlow code for the neural network presented in the paper: "Structural Language Models of Code" (ICML'2020)
  ☆87Updated 2 years ago