Fastly, Inc. (FSLY), a leading edge cloud platform provider, saw its stock soar 5.38% in the intraday trading session on Wednesday, following the company's announcement of the general availability of its Fastly AI Accelerator.

The AI Accelerator is a semantic caching solution designed to optimize the performance of large language model (LLM) generative AI applications. By leveraging Fastly's edge cloud platform, the solution allows developers to cache and respond to repeated queries, reducing the need to repeatedly call the AI provider. This results in an average of 9x faster response times for applications using OpenAI's ChatGPT and Microsoft Azure AI Foundry, which are currently supported by the accelerator.

With just a single line of code update, developers can optimize their AI applications to utilize the new AI Accelerator, enjoying more efficient performance, lower costs, and an overall better user experience. The accelerator's caching capabilities at the edge are expected to drive wider adoption of generative AI applications by addressing performance bottlenecks and reducing computational costs.