Alternatives and similar repositories for code_tokenize

Users that are interested in code_tokenize are comparing it to the libraries listed below

• cedricrupb / code_ast
  Fast and robust AST parsing of any language
  ☆39Updated 4 months ago
• cedricrupb / code_diff
  Fast AST based code differencing in Python
  ☆34Updated 4 months ago
• giganticode / codeprep
  A toolkit for pre-processing large source code corpora
  ☆47Updated 2 years ago
• eth-sri / TFix
  ☆67Updated 3 years ago
• google-research-datasets / great
  The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…
  ☆22Updated 4 years ago
• jianguda / mrncs
  ☆23Updated 2 years ago
• giganticode / probes
  Probing pre-trained source code models
  ☆15Updated 3 years ago
• DeepSoftwareAnalytics / CommitMsgEmpirical
  ☆28Updated 2 years ago
• shrivastavadisha / repo_level_prompt_generation
  ☆124Updated 2 years ago
• google-research / plur
  PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…
  ☆88Updated 3 years ago
• cedricrupb / TSSB3M
  Mining tool and large-scale datasets of single statement bug fixes in Python
  ☆16Updated last year
• TruX-DTF / AVATAR
  AVATAR: Fixing Semantic Bugs with Fix Patterns of Static Analysis Violations
  ☆27Updated 4 years ago
• RosaliaTufano / code_review
  ☆36Updated 3 years ago
• degraphcs / DeGraphCS
  ☆29Updated 4 years ago
• wasiahmad / AVATAR
  Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.
  ☆54Updated 9 months ago
• VHellendoorn / ICLR20-Great
  Data and Code for Reproducing "Global Relational Models of Source Code"
  ☆84Updated 4 years ago
• soarsmu / BugsInPy
  BugsInPy: Benchmarking Bugs in Python Projects
  ☆96Updated 10 months ago
• yuewang-cuhk / awesome-programming-language-pretraining-papers
  Recent Advances in Programming Language Pre-Trained Models (PL-PTMs)
  ☆58Updated 3 years ago
• tech-srl / slm-code-generation
  TensorFlow code for the neural network presented in the paper: "Structural Language Models of Code" (ICML'2020)
  ☆88Updated 2 years ago
• EngineeringSoftware / CoditT5
  CoditT5: Pretraining for Source Code and Natural Language Editing
  ☆28Updated 4 months ago
• tech-srl / c3po
  Code for the paper "A Structural Model for Contextual Code Changes"
  ☆32Updated last year
• amazon-science / mxeval
  ☆110Updated 9 months ago
• saltudelft / codefill
  Contains the code and data for our #ICSE2022 paper titled as "CodeFill: Multi-token Code Completion by Jointly Learning from Structure an…
  ☆15Updated 2 years ago
• eth-sri / learning-real-bug-detector
  ☆16Updated 7 months ago
• reddy-lab-code-research / StructCoder
  Code for "StructCoder: Structure-Aware Transformer for Code Generation"
  ☆74Updated last year
• wangdeze18 / Multilingual-Adapter-for-SE
  ☆17Updated 2 years ago
• justinphan3110 / CoTexT
  Code implementation for CoTexT: Multi-task Learning with Code-Text Transformer
  ☆36Updated 3 years ago
• zwzhang44 / DietCode
  ☆20Updated 2 years ago
• bdqnghi / ast-node-encoding
  A tool to convert nodes in an Abstract Syntax Tree into vector embeddings
  ☆75Updated 3 years ago
• micheletufano / NeuralCodeTranslator
  Neural Code Translator provides instructions, datasets, and a deep learning infrastructure (based on seq2seq) that aims at learning code …
  ☆38Updated 6 years ago