Driving Generative AI Innovation: AWS LLM Development Support Program Success Stories and Results

Revolutionizing Generative AI with AWS LLM Development Support Program in Japan

Amazon Web Services (AWS) has always been at the forefront of supporting innovation and technological advancement across various industries. Through the AWS LLM Development Support Program in Japan, AWS has been instrumental in empowering companies and organizations to harness the power of large language models (LLMs) and foundation models (FMs) to drive progress and transformation.

Empowering Innovation

The AWS LLM Development Support Program has provided comprehensive support to 15 diverse organizations, enabling them to explore the capabilities of LLMs and FMs and develop pioneering solutions for their industries. From startups to global enterprises, these organizations have leveraged the program to accelerate their generative AI initiatives and push the boundaries of what’s possible with AI.

Leading the Way in Generative AI

One of the standout success stories from the program is Ricoh, which developed a Japanese-English bilingual LLM using a unique curriculum learning strategy. By gradually introducing complex data to their model, Ricoh was able to train a competitive and efficient LLM that demonstrated strong logical reasoning performance.

Stockmark also made significant strides in the development of highly reliable LLMs for industrial applications by pretraining a Japanese LLM to mitigate hallucination. By focusing on enhancing the amount of knowledge in their model and leveraging AWS Trainium for training, Stockmark was able to address critical concerns in real-world use cases.

NTT, in collaboration with Intel and Sony, developed the lightweight and high-performance LLM tsuzumi, which showcases high Japanese language proficiency and multi-modal capabilities. By utilizing AWS infrastructure and technical expertise, NTT was able to launch a cluster for efficient distributed training and validate their model on AWS.

Unlocking the Potential of Generative AI

Participants in the program demonstrated the transformative potential of generative AI by developing domain-specific models, multi-modal models, and linguistically-diverse models. Companies like KARAKURI, Watashiha, Poetics, and Matsuo Institute leveraged Trainium to create specialized LLMs tailored to specific industries and tasks, while Turing and Preferred Networks explored the integration of language and visual modalities for enhanced AI capabilities.

By partnering with AWS and participating in the LLM Program, these organizations have been able to push the boundaries of generative AI and develop innovative solutions that have the potential to revolutionize various industries.

Driving Innovation Forward

As the program continues to foster generative AI innovation in Japan, AWS remains committed to supporting companies and organizations in deploying transformative models and bringing generative AI innovation to real-world applications. With the ongoing support of Japan’s Ministry of Economy, Trade, and Industry (METI), the future looks bright for the continued development and adoption of generative AI technologies.

Together with AWS, these pioneering organizations are paving the way for a future where generative AI will play a crucial role in driving innovation and progress across industries.

For more information on how AWS is revolutionizing generative AI with the LLM Development Support Program, visit the AWS Trainium website.

This post is contributed by the AWS LLM Development Support Program Executive Committee and Technical Core Team, with Executive Sponsorship represented by Yukiko Sato.

About the Authors

Yoshitaka Haribara is a Senior Startup ML Solutions Architect at AWS Japan. In his spare time, Yoshitaka enjoys playing the drums.

Shruti Koparkar is a Senior Product Marketing Manager at AWS, helping customers explore and adopt Amazon EC2 accelerated computing infrastructure for their machine learning needs.