Stability AI releases new coding assistance AI 'Stable Code 3B', demonstrating performance equivalent to Meta's 'Code Llama 7B' with fewer parameters

On January 17, 2024, Stability AI, known for developing the image generation AI 'Stable Diffusion', announced 'Stable Code 3B' as a new coding assistance AI following ' Stable Code Alpha 3B' released in August 2023. announced the release of ``.

Stable Code 3B: Coding on the Edge — Stability AI

Today, we announce our first Large Language Model release of 2024: Stable Code 3B. This new LLM is available for non-commercial & commercial use through our new Stability AI Membership: https://t.co/u1Dg5zz3lM

Learn more here: https://t.co/6zy9gUIF0F pic.twitter.com/UStFwZe1m5

— Stability AI (@StabilityAI) January 16, 2024

The following article provides a detailed summary of ' Stable Code Alpha 3B ' released by Stability AI in August 2023.

Stability AI announces open source coding assistance AI 'StableCode' - GIGAZINE

The 'Stable Code 3B' announced this time is a follow-up to this Stable Code Alpha 3B, and Stability AI says, 'This is the first large-scale release of Stable Code.'

A new feature added to Stable Code Alpha 3B is a code completion feature called 'Fill in the Middle (FIM)' that automatically fills in missing sections in the code. Also, the context size has been significantly expanded since Stable Code Alpha 3B.

Although Stable Code 3B only has 3 billion parameters, it is as accurate and responsive as, or better than, larger models like Meta's 7 billion parameter code Llama 7B. Enables high code completion. In addition, Stable Code 3B, which is 60% smaller than Code Llama 7B, can be run offline even on general laptops that do not have a dedicated GPU, such as the MacBook Air.

According to Stability AI, Stable Code 3B is based on the basic model of ` `Stable LM 3B '' trained with 4 trillion tokens of natural language data, and further trained with software engineering-specific data including code.

Below is a performance comparison between Stable Code 3B (purple) and Code Llama 7B (blue) published by Stability AI. It has been reported that while Code Llama 7B outperforms Code Llama 7B in PHP and Rust , it has equivalent performance in JavaScript and Java , and Stable Code 3B outperforms Code Llama 7B in Python and C++ .

The performance of Stable Code 3B is superior compared to other coding assistant AIs, and the table below shows that the performance of Stable Code 3B exceeds the performance of other coding assistant AIs such as '

Stable Code 3B can be downloaded from the link below. It is also possible to use it commercially by registering for