NEC Corporation Expands “NEC cotomi” Generative AI Services with High-Speed LLM Models

NEC Corporation, a global leader in technology, has once again pushed the boundaries of innovation with the launch of two new high-speed generative AI Large Language Models (LLMs) – NEC cotomi Pro and NEC cotomi Light.

In recent years, the field of generative AI has seen significant advancements, with organizations exploring the potential for business transformation using LLMs. As specific application scenarios emerge, there is a growing demand for models that can meet customer needs in terms of response time, data coordination, and information security.

NEC’s new NEC cotomi Pro and NEC cotomi Light models are designed to address these needs with their high-speed, high-performance capabilities. Despite their compact size, these models deliver performance on par with top global models like “GPT-4” and “Claude 2,” but at more than ten times the speed.

What sets these models apart is NEC’s innovative approach to training methods and architecture. While traditionally, increasing the size of a model would slow down its operating speed, NEC has managed to achieve both speed and performance improvements with its advanced new techniques.

NEC cotomi Pro boasts a response time that is approximately 87% faster than GPT-4, while NEC cotomi Light can process a large number of requests at high speed with just 1 to 2 GPUs. This makes them ideal for a wide range of tasks that require quick and accurate responses.

One impressive application of these models is in an in-house document retrieval system using the RAG technique. Here, the system achieved a correct response rate higher than GPT-3.5 without fine-tuning and a response rate higher than GPT-4 after fine-tuning, with a response time that is approximately 93% faster.

Overall, NEC’s NEC cotomi Pro and NEC cotomi Light represent a major step forward in the field of generative AI, offering organizations the tools they need to drive business transformation and innovation. With their high-speed, high-performance capabilities, these models are sure to make a significant impact in a wide range of industries.