Skip to content

About

A LLM for Code Generation using the Glaive Code Assistant dataset

Resources

Stars

0 stars

Watchers

0 watching

Forks

 
 

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

LLM-CodeGen

A LLM for Code Generation using the Glaive Code Assistant dataset

glaive-code-assistant

Current Updates

LLM trains sucessfully, trianing loss is at a 1.1, code generated sucessfully completes prompted task

Possible Enhancments

Use custom tokenizer instead of the gpt2 tokenizer.

Resources

This project was done in part by Andrej Karpathy's lecture on GPT architecture, as well as A Survey of Large Language Models (Wayne Xin Zhao et al.) and Attention Is All You Need (Ashish Vaswani et al.)

Conceptual Framework

  1. ✅ Code Generation with LLM: Use an LLM to generate code based on natural language descriptions. The LLM can be trained or fine-tuned on a dataset of code snippets paired with their descriptions to understand how to translate user input into syntactically correct code.

  2. Code Refinement using GANs: Employ a GAN where the generator is used to produce variations of the initial code generated by the LLM, and the discriminator is used to evaluate the quality of the code. The discriminator checks for functionality, optimization, and how well the code meets the requirements specified in the user's description.

About

A LLM for Code Generation using the Glaive Code Assistant dataset

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages