Software Performance Engineering for FMware

AIware Leadership Bootcamp 2024November 8, 2024Toronto, CanadaSpeaker, with Haoxiang Zhang

Play video

Lecture on performance engineering for software built on foundation models: decoding, model serving with vLLM, and end-to-end performance.

• Bootcamp