Alternatives and similar repositories for code_tokenize

Users that are interested in code_tokenize are comparing it to the libraries listed below

• cedricrupb / code_diff
  Fast AST based code differencing in Python
  ☆36Updated 10 months ago
• giganticode / codeprep
  A toolkit for pre-processing large source code corpora
  ☆47Updated 3 years ago
• eth-sri / TFix
  ☆69Updated 3 years ago
• utopia-group / TypeT5
  Seq2seq Type Inference using Static Analysis and CodeT5
  ☆32Updated 2 years ago
• IBM / tree-sitter-codeviews
  Extract and combine multiple source code views using tree-sitter
  ☆155Updated 2 months ago
• saltudelft / type4py
  Type4Py: Deep Similarity Learning-Based Type Inference for Python
  ☆65Updated 2 years ago
• cedricrupb / TSSB3M
  Mining tool and large-scale datasets of single statement bug fixes in Python
  ☆18Updated 2 years ago
• bdqnghi / ast-node-encoding
  A tool to convert nodes in an Abstract Syntax Tree into vector embeddings
  ☆76Updated 3 years ago
• microsoft / neurips21-self-supervised-bug-detection-and-repair
  Replication Code for "Self-Supervised Bug Detection and Repair" NeurIPS 2021
  ☆112Updated 3 years ago
• wasiahmad / AVATAR
  Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.
  ☆58Updated last year
• VHellendoorn / ICLR20-Great
  Data and Code for Reproducing "Global Relational Models of Source Code"
  ☆84Updated 4 years ago
• casics / spiral
  A Python 3 module that provides functions for splitting identifiers found in source code files.
  ☆48Updated 2 years ago
• danhper / bigcode-tools
  Set of tools to help working with "Big Code"
  ☆43Updated 3 years ago
• microsoft / codamosa
  ☆152Updated 6 months ago
• reddy-lab-code-research / StructCoder
  Code for "StructCoder: Structure-Aware Transformer for Code Generation"
  ☆76Updated last year
• AI-nstein / hoppity
  Hoppity
  ☆60Updated 5 years ago
• rizwan09 / REDCODER
  ☆45Updated 5 months ago
• shrivastavadisha / repo_level_prompt_generation
  ☆127Updated 2 years ago
• google-research-datasets / great
  The dataset for the variable-misuse task, used in the ICLR 2020 paper 'Global Relational Models of Source Code' [https://openreview.net/f…
  ☆22Updated 5 years ago
• giganticode / probes
  Probing pre-trained source code models
  ☆15Updated 3 years ago
• amazon-science / recode
  Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"
  ☆55Updated last year
• tech-srl / c3po
  Code for the paper "A Structural Model for Contextual Code Changes"
  ☆32Updated 2 years ago
• soarsmu / BugsInPy
  BugsInPy: Benchmarking Bugs in Python Projects
  ☆117Updated 2 months ago
• dpfried / incoder
  Generative model for code infilling and synthesis
  ☆308Updated 2 years ago
• bdqnghi / awesome-ai4code
  A collection of recent papers, benchmarks and datasets of AI4Code domain.
  ☆58Updated last year
• micheletufano / NeuralCodeTranslator
  Neural Code Translator provides instructions, datasets, and a deep learning infrastructure (based on seq2seq) that aims at learning code …
  ☆38Updated 6 years ago
• cedricrupb / code_ast
  Fast and robust AST parsing of any language
  ☆60Updated 3 weeks ago
• soarsmu / Compressor
  Replication Package for "Compressing Pre-trained Models of Code into 3 MB", ASE 2022
  ☆31Updated last year
• typilus / typilus
  Code for "Typilus: Neural Type Hints" PLDI 2020
  ☆62Updated 2 years ago
• parasj / contracode
  Contrastive Code Representation Learning: functionality-based JavaScript embeddings through self-supervised learning
  ☆168Updated 3 years ago