Page 63 - Red Hat PR REPORT - MAY 2024
P. 63

5/13/24, 3:00 PM                             Red Hat Saddles Up For The Wide Open GenAI Horizons
                               “This allows you to do not just deployments of LLMs
                               into massive scale, but also being able to handle natural
                               language processing and other tasks,” Griffin said. “We
                               get those out-of-the-box capabilities that allow the
                               customers to pick and choose whether you’re running
                               vLLM for runtimes in one place or maybe you have a
                               custom runtime that’s optimized for specifically your
                               use case. You have that flexibility to really quickly and
                               seamlessly choose the right runtime for your models,
                               whether it’s predictive or GenAI.”


                               Red Hat also is rolling out Podman AI Lab, making it
                               easier for developers to build, test, and run generative
                               AI-based software in containers on their workstations
                               using a graphical interface, adding to the industry-wide
                               push to enable AI applications to run locally on devices
                               rather than having to send the workloads to the cloud.
                               It’s part of emerging edge AI trend to better AI-enable
                               Internet of Things (IoT) and other edge devices to
                               reduce latency and save money.





















































      https://www.nextplatform.com/2024/05/07/red-hat-saddles-up-for-the-wide-open-genai-horizons/                  5/5
   58   59   60   61   62   63   64   65   66   67   68