Code-autocomplete, a code completion plugin for Python

Last update: Jan 07, 2023

Related tags

Text Data & NLP code-autocomplete

Overview

Code AutoComplete

code-autocomplete, a code completion plugin for Python.

code-autocomplete实现了Python代码行粒度和块粒度自动补全功能。

Guide

Feature
Install
Usage
Contact
Citation
Reference

Feature

Demo

http://42.193.145.218/product/short_text_sim/

Install

pip3 install -U code-autocomplete

git clone https://github.com/shibing624/code-autocomplete.git
cd code-autocomplete
python3 setup.py install

Usage

Code Completion

开源项目：code-autocomplete，可支持GPT2模型，通过如下命令调用：

from autocomplete.gpt2 import Infer
m = Infer(model_name="gpt2", model_dir="shibing624/code-autocomplete-gpt2-base", use_cuda=False)
i = m.predict('import torch.nn as')
print(i)

当然，你也可使用官方的huggingface/transformers调用：

Please use 'GPT2' related functions to load this model!

import os
import torch
from transformers import GPT2Tokenizer, GPT2LMHeadModel

os.environ["KMP_DUPLICATE_LIB_OK"] = "TRUE"
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

tokenizer = GPT2Tokenizer.from_pretrained("shibing624/code-autocomplete-gpt2-base")
model = GPT2LMHeadModel.from_pretrained("shibing624/code-autocomplete-gpt2-base")
model.to(device)
prompts = [
    """from torch import nn
    class LSTM(Module):
        def __init__(self, *,
                     n_tokens: int,
                     embedding_size: int,
                     hidden_size: int,
                     n_layers: int):""",
    """import numpy as np
    import torch
    import torch.nn as""",
    "import java.util.ArrayList",
    "def factorial(n):",
]
for prompt in prompts:
    input_ids = tokenizer.encode(prompt, add_special_tokens=False, return_tensors='pt').to(device)
    outputs = model.generate(input_ids=input_ids,
                             max_length=64 + len(prompt),
                             temperature=1.0,
                             top_k=50,
                             top_p=0.95,
                             repetition_penalty=1.0,
                             do_sample=True,
                             num_return_sequences=1,
                             length_penalty=2.0,
                             early_stopping=True)
    decoded = tokenizer.decode(outputs[0], skip_special_tokens=True)
    print(decoded)
    print("=" * 20)

Contact

Issue(建议)：
邮件我：xuming: [email protected]
微信我：加我微信号：xuming624, 备注：个人名称-公司-NLP 进NLP交流群。

Citation

如果你在研究中使用了code-autocomplete，请按如下格式引用：

@misc{code-autocomplete,
  author = {Xu Ming},
  title = {code-autocomplete: Code AutoComplete with GPT model},
  year = {2022},
  publisher = {GitHub},
  journal = {GitHub repository},
  url = {https://github.com/shibing624/code-autocomplete},
}

License

授权协议为 The Apache License 2.0，可免费用做商业用途。请在产品说明中附加code-autocomplete的链接和授权协议。

Contribute

项目代码还很粗糙，如果大家对代码有所改进，欢迎提交回本项目，在提交之前，注意以下两点：

在tests添加相应的单元测试
使用python setup.py test来运行所有单元测试，确保所有单测都是通过的

之后即可提交PR。

Reference

https://github.com/galois-autocompleter/galois-autocompleter

Code to use Augmented Shapiro Wilks Stopping, as well as code for the paper "Statistically Signifigant Stopping of Neural Network Training"

This codebase is being actively maintained, please create and issue if you have issues using it Basics All data files are included under losses and ea

32 Nov 9, 2021

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation This is the official PyTorch implementation

564 Jan 8, 2023

Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2.

Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2. It is trained (finetuned) on a curated list of approximately 45K Python (~470MB) files gathered from the Github. Currently, it just works properly on Python but not bad at other languages (thanks to GPT-2's power).

91 Sep 23, 2022

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

Ucto for Python This is a Python binding to the tokeniser Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task,

27 Dec 14, 2022

0.0.4(Mar 1, 2022)

Full Changelog: https://github.com/shibing624/code-autocomplete/compare/0.0.3...0.0.4
Source code(tar.gz)
Source code(zip)
source_code.zip(105.14 MB)
0.0.3(Feb 14, 2022)

python-source-code
Source code(tar.gz)
Source code(zip)
download.zip(41.44 MB)
0.0.1(Feb 11, 2022)

0.0.1 GPT2 code autocomplete.
Source code(tar.gz)
Source code(zip)

Code-autocomplete, a code completion plugin for Python

Related tags

Overview

Code AutoComplete

Feature

Demo

Install

Usage

Code Completion

Contact

Citation

License

Contribute

Reference

You might also like...

Code to use Augmented Shapiro Wilks Stopping, as well as code for the paper "Statistically Signifigant Stopping of Neural Network Training"

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2.

Simple python code to fix your combo list by removing any text after a separator or removing duplicate combos

A python project made to generate code using either OpenAI's codex or GPT-J (Although not as good as codex)

Repository of the Code to Chatbots, developed in Python

Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations

Converts python code into c++ by using OpenAI CODEX.

Releases(0.0.4)

0.0.4(Mar 1, 2022)

0.0.3(Feb 14, 2022)

0.0.1(Feb 11, 2022)

Owner

xuming

मराठी भाषा वाचविण्याचा एक प्रयास. इंग्रजी ते मराठीचा शब्दकोश. An attempt to preserve the Marathi language. A lightweight and ad free English to Marathi thesaurus.

Codes for coreference-aware machine reading comprehension

Paddlespeech Streaming ASR GUI

Code examples for my Write Better Python Code series on YouTube.

Must-read papers on improving efficiency for pre-trained language models.

Deep Learning for Natural Language Processing - Lectures 2021

Code for paper Multitask-Finetuning of Zero-shot Vision-Language Models

Code for hyperboloid embeddings for knowledge graph entities

InferSent sentence embeddings

🐍 A hyper-fast Python module for reading/writing JSON data using Rust's serde-json.

뉴스 도메인 질의응답 시스템 (21-1학기 졸업 프로젝트)

Yet Another Compiler Visualizer

Transformer - A TensorFlow Implementation of the Transformer: Attention Is All You Need

Pipeline for fast building text classification TF-IDF + LogReg baselines.

Bnagla hand written document digiiztion

Implementing SimCSE(paper, official repository) using TensorFlow 2 and KR-BERT.

PyTorch Implementation of the paper Single Image Texture Translation for Data Augmentation

ZUNIT - Toward Zero-Shot Unsupervised Image-to-Image Translation

A Semi-Intelligent ChatBot filled with statistical and economical data for the Premier League.

Rhythm-Finder is a unsupervised ML driven python powered web-application that can find the songs that suits you.