Page 63 - Red Hat PR REPORT - MAY 2024

5/13/24, 3:00 PM Red Hat Saddles Up For The Wide Open GenAI Horizons
“This allows you to do not just deployments of LLMs
into massive scale, but also being able to handle natural
language processing and other tasks,” Griffin said. “We
get those out-of-the-box capabilities that allow the
customers to pick and choose whether you’re running
vLLM for runtimes in one place or maybe you have a
custom runtime that’s optimized for specifically your
use case. You have that flexibility to really quickly and
seamlessly choose the right runtime for your models,
whether it’s predictive or GenAI.”

Red Hat also is rolling out Podman AI Lab, making it
easier for developers to build, test, and run generative
AI-based software in containers on their workstations
using a graphical interface, adding to the industry-wide
push to enable AI applications to run locally on devices
rather than having to send the workloads to the cloud.
It’s part of emerging edge AI trend to better AI-enable
Internet of Things (IoT) and other edge devices to
reduce latency and save money.

https://www.nextplatform.com/2024/05/07/red-hat-saddles-up-for-the-wide-open-genai-horizons/ 5/5