Stability AI releases Japanese language model 'Japanese StableLM Alpha'



Stability AI, an AI development company known for image generation AI '

Stable Diffusion ' and its high-performance version ' SDXL ', has developed a general-purpose language model for Japanese ' Japanese StableLM Base Alpha 7B ' and an instruction-response language model ' Japanese StableLM Instruct Alpha 7B ” has been announced.

Japanese Language Model “Japanese StableLM Alpha” Released — Stability AI Japan
https://ja.stability.ai/blog/japanese-stablelm-alpha



“Japanese StableLM” is the Japanese version of the open source large-scale language model “StableLM” announced in April 2023.

Stability AI releases a large-scale language model ``StableLM'' that is open source and can be used commercially-GIGAZINE



The general-purpose language model 'Japanese StableLM Base Alpha 7B' is a model with 7 billion parameters that has been trained to generate text using large-scale data centered on the web. The learning data is mainly in Japanese and English, and about 2% of the source code is included, and the learning was done with 750 billion tokens.

The instruction-response language model ``Japanese StableLM Instruct Alpha 7B'' is a version of ``Japanese StableLM Base Alpha 7B'' with additional learning so that it can respond to user instructions.

An example response looks like this:




Both are published on Hugging Face Hub in a format compliant with Hugging Face Transformers.

stabilityai/japanese-stablelm-base-alpha-7b Hugging Face
https://huggingface.co/stabilityai/japanese-stablelm-base-alpha-7b

stabilityai/japanese-stablelm-instruct-alpha-7b Hugging Face
https://huggingface.co/stabilityai/japanese-stablelm-instruct-alpha-7b

'Japanese StableLM Base Alpha 7B' is released under the commercially available Apache License 2.0, but 'Japanese StableLM Instruct Alpha 7B' is a model for research purposes, so it is open to the public only for research purposes. .

Stability AI Japan plans to continue building and releasing such generative base models for Japan in the future.

From 18:00 on August 10, 2023, a talk event with the developer will be held at the official Disctord.



Related Posts:

in Software, Posted by logc_nt