web02.fireside.fm Thu, 09 Apr 2026 04:20:01 -0500 Fireside (https://fireside.fm) Pipeline Conversations - Episodes Tagged with β€œGenai” https://podcast.zenml.io/tags/genai Wed, 15 Jan 2025 08:00:00 +0100 Pipeline Conversations brings you interviews with platform engineers, ML practitioners, and technical leaders building production AI systems. We dig into the real challenges of MLOps and LLMOps: orchestrating complex workflows on Kubernetes, fine-tuning and evaluating models at scale, and shipping AI that actually works. From ZenML. en-us episodic MLOps and LLMOps, from the trenches ZenML GmbH Pipeline Conversations brings you interviews with platform engineers, ML practitioners, and technical leaders building production AI systems. We dig into the real challenges of MLOps and LLMOps: orchestrating complex workflows on Kubernetes, fine-tuning and evaluating models at scale, and shipping AI that actually works. From ZenML. no machine-learning, machinelearning, mlops, deeplearning, ai, artificialintelligence, artificial-intelligence, technology, tech, mlops, llmops ZenML GmbH podcast@zenml.io Production LLM Security: Real-world Strategies from Industry Leaders πŸ” https://podcast.zenml.io/llmops-db-security 2ac46862-3236-4293-a5e0-401e1eb47334 Wed, 15 Jan 2025 08:00:00 +0100 ZenML GmbH full 3 ZenML GmbH Learn how leading companies like Dropbox, NVIDIA, and Slack tackle LLM security in production. 51:35 no Learn how leading companies like Dropbox, NVIDIA, and Slack tackle LLM security in production. This comprehensive guide covers practical strategies for preventing prompt injection, securing RAG systems, and implementing multi-layered defenses, based on real-world case studies from the LLMOps database. Discover battle-tested approaches to input validation, data privacy, and monitoring for building secure AI applications. Please read the full blog post here (https://www.zenml.io/blog/production-llm-security-real-world-strategies-from-industry-leaders) and the associated LLMOps database entries here (https://zenml.io/llmops-database). llmops, llms, ai, mlops, genai, security Learn how leading companies like Dropbox, NVIDIA, and Slack tackle LLM security in production. This comprehensive guide covers practical strategies for preventing prompt injection, securing RAG systems, and implementing multi-layered defenses, based on real-world case studies from the LLMOps database. Discover battle-tested approaches to input validation, data privacy, and monitoring for building secure AI applications.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Learn how leading companies like Dropbox, NVIDIA, and Slack tackle LLM security in production. This comprehensive guide covers practical strategies for preventing prompt injection, securing RAG systems, and implementing multi-layered defenses, based on real-world case studies from the LLMOps database. Discover battle-tested approaches to input validation, data privacy, and monitoring for building secure AI applications.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Optimizing LLM Performance and Cost for LLMs in Production https://podcast.zenml.io/llmops-db-performance-and-cost-optimization 850c441c-eb0b-4d22-ad8d-3da4224b35b6 Mon, 13 Jan 2025 08:00:00 +0100 ZenML GmbH full 3 ZenML GmbH A deep dive into the world of LLM optimization and cost management - a critical challenge facing AI teams today. 33:49 no In this episode, we dive deep into the world of LLM optimization and cost management - a critical challenge facing AI teams today. Join us as we explore real-world strategies from companies like Dropbox, Meta, and Replit who are pushing the boundaries of what's possible with large language models. From clever model selection techniques and knowledge distillation to advanced inference optimization and cost-saving strategies, we'll unpack the tools and approaches that are helping organizations squeeze maximum value from their LLM deployments. Whether you're dealing with runaway API costs, struggling with inference latency, or looking to optimize your model infrastructure, this episode provides practical insights that you can apply to your own AI initiatives. Perfect for ML engineers, technical leads, and anyone responsible for maintaining LLM systems in production. Please read the full blog post here (https://www.zenml.io/blog/optimizing-llm-performance-and-cost-squeezing-every-drop-of-value) and the associated LLMOps database entries here (https://zenml.io/llmops-database). llmops, llms, ai, mlops, genai, optimization, performance, cost In this episode, we dive deep into the world of LLM optimization and cost management - a critical challenge facing AI teams today. Join us as we explore real-world strategies from companies like Dropbox, Meta, and Replit who are pushing the boundaries of what's possible with large language models. From clever model selection techniques and knowledge distillation to advanced inference optimization and cost-saving strategies, we'll unpack the tools and approaches that are helping organizations squeeze maximum value from their LLM deployments. Whether you're dealing with runaway API costs, struggling with inference latency, or looking to optimize your model infrastructure, this episode provides practical insights that you can apply to your own AI initiatives. Perfect for ML engineers, technical leads, and anyone responsible for maintaining LLM systems in production.

Please read the full blog post here and the associated LLMOps database entries here.

]]> In this episode, we dive deep into the world of LLM optimization and cost management - a critical challenge facing AI teams today. Join us as we explore real-world strategies from companies like Dropbox, Meta, and Replit who are pushing the boundaries of what's possible with large language models. From clever model selection techniques and knowledge distillation to advanced inference optimization and cost-saving strategies, we'll unpack the tools and approaches that are helping organizations squeeze maximum value from their LLM deployments. Whether you're dealing with runaway API costs, struggling with inference latency, or looking to optimize your model infrastructure, this episode provides practical insights that you can apply to your own AI initiatives. Perfect for ML engineers, technical leads, and anyone responsible for maintaining LLM systems in production.

Please read the full blog post here and the associated LLMOps database entries here.

]]> The Evaluation Playbook: Making LLMs Production-Ready πŸ§ͺπŸ“ˆ https://podcast.zenml.io/llmops-db-evaluation 8254e8a5-306a-46c6-9695-ecd0daea4150 Sun, 15 Dec 2024 21:00:00 +0100 ZenML GmbH full 3 ZenML GmbH A comprehensive exploration of real-world lessons in LLM evaluation and quality assurance, examining how industry leaders tackle the challenges of assessing language models in production. 32:43 no A comprehensive exploration of real-world lessons in LLM evaluation and quality assurance, examining how industry leaders tackle the challenges of assessing language models in production. Through diverse case studies, we cover the transition from traditional ML evaluation, establishing clear metrics, combining automated and human evaluation strategies, and implementing continuous improvement cycles to ensure reliable LLM applications at scale. Please read the full blog post here (https://www.zenml.io/blog/the-evaluation-playbook-making-llms-production-ready) and the associated LLMOps database entries here (https://zenml.io/llmops-database). llmops, llms, ai, mlops, genai, evaluation A comprehensive exploration of real-world lessons in LLM evaluation and quality assurance, examining how industry leaders tackle the challenges of assessing language models in production.

Through diverse case studies, we cover the transition from traditional ML evaluation, establishing clear metrics, combining automated and human evaluation strategies, and implementing continuous improvement cycles to ensure reliable LLM applications at scale.

Please read the full blog post here and the associated LLMOps database entries here.

]]> A comprehensive exploration of real-world lessons in LLM evaluation and quality assurance, examining how industry leaders tackle the challenges of assessing language models in production.

Through diverse case studies, we cover the transition from traditional ML evaluation, establishing clear metrics, combining automated and human evaluation strategies, and implementing continuous improvement cycles to ensure reliable LLM applications at scale.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Prompt Engineering & Management in Production: Practical Lessons from the LLMOps Database https://podcast.zenml.io/llmops-db-prompt-engineering a1117f0f-33e9-464b-a6e5-7c7eee9d39a0 Wed, 11 Dec 2024 06:30:00 +0100 ZenML GmbH full 3 ZenML GmbH Prompt engineering is the art and science of crafting instructions that unlock the potential of large language models (LLMs). It's a critical skill for anyone working with LLMs, whether you're building cutting-edge applications or conducting fundamental research. But what does effective prompt engineering look like in practice, and how can we systematically improve our prompts over time? 29:34 no Prompt engineering is the art and science of crafting instructions that unlock the potential of large language models (LLMs). It's a critical skill for anyone working with LLMs, whether you're building cutting-edge applications or conducting fundamental research. But what does effective prompt engineering look like in practice, and how can we systematically improve our prompts over time? To answer these questions, we've distilled key insights and techniques from a collection of LLMOps case studies spanning diverse industries and applications. From designing robust prompts to iterative refinement, optimization strategies to management infrastructure, these battle-tested lessons provide a roadmap for prompt engineering mastery. Please read the full blog post here (https://www.zenml.io/blog/prompt-engineering-management-in-production-practical-lessons-from-the-llmops-database) and the associated LLMOps database entries here (https://zenml.io/llmops-database). llmops, llms, ai, mlops, genai, prompts, prompt-engineering Prompt engineering is the art and science of crafting instructions that unlock the potential of large language models (LLMs). It's a critical skill for anyone working with LLMs, whether you're building cutting-edge applications or conducting fundamental research. But what does effective prompt engineering look like in practice, and how can we systematically improve our prompts over time?

To answer these questions, we've distilled key insights and techniques from a collection of LLMOps case studies spanning diverse industries and applications. From designing robust prompts to iterative refinement, optimization strategies to management infrastructure, these battle-tested lessons provide a roadmap for prompt engineering mastery.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Prompt engineering is the art and science of crafting instructions that unlock the potential of large language models (LLMs). It's a critical skill for anyone working with LLMs, whether you're building cutting-edge applications or conducting fundamental research. But what does effective prompt engineering look like in practice, and how can we systematically improve our prompts over time?

To answer these questions, we've distilled key insights and techniques from a collection of LLMOps case studies spanning diverse industries and applications. From designing robust prompts to iterative refinement, optimization strategies to management infrastructure, these battle-tested lessons provide a roadmap for prompt engineering mastery.

Please read the full blog post here and the associated LLMOps database entries here.

]]> LLM Agents in Production: Architectures, Challenges, and Best Practices https://podcast.zenml.io/llmops-db-agents 243fce06-742f-4c5f-83a9-c131ef0b3c16 Mon, 09 Dec 2024 08:00:00 +0100 ZenML GmbH full 3 ZenML GmbH An in-depth exploration of LLM agents in production environments, covering key architectures, practical challenges, and best practices. 32:37 no An in-depth exploration of LLM agents in production environments, covering key architectures, practical challenges, and best practices. Drawing from real-world case studies, this article examines the current state of AI agent deployment, infrastructure requirements, and critical considerations for organizations looking to implement these systems safely and effectively. Please read the full blog post here (https://www.zenml.io/blog/llm-agents-in-production-architectures-challenges-and-best-practices) and the associated LLMOps database entries here (https://zenml.io/llmops-database). llmops, llms, ai, mlops, genai, agents, agentic, agent An in-depth exploration of LLM agents in production environments, covering key architectures, practical challenges, and best practices. Drawing from real-world case studies, this article examines the current state of AI agent deployment, infrastructure requirements, and critical considerations for organizations looking to implement these systems safely and effectively.

Please read the full blog post here and the associated LLMOps database entries here.

]]> An in-depth exploration of LLM agents in production environments, covering key architectures, practical challenges, and best practices. Drawing from real-world case studies, this article examines the current state of AI agent deployment, infrastructure requirements, and critical considerations for organizations looking to implement these systems safely and effectively.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Building Advanced Search, Retrieval, and Recommendation Systems with LLMs https://podcast.zenml.io/llmops-db-embeddings 85b0a210-9235-4176-bff0-cc81fe727c40 Fri, 06 Dec 2024 08:00:00 +0100 ZenML GmbH full 3 ZenML GmbH Discover how embeddings power modern search and recommendation systems with LLMs. 13:08 no Discover how embeddings power modern search and recommendation systems with LLMs, using case studies from the LLMOps Database. From RAG systems to personalized recommendations, learn key strategies and best practices for building intelligent applications that truly understand user intent and deliver relevant results. Please read the full blog post here (https://www.zenml.io/blog/building-advanced-search-retrieval-and-recommendation-systems-with-llms) and the associated LLMOps database entries here (https://zenml.io/llmops-database). rag, llmops, llms, ai, mlops, genai, embeddings, search, recommendation Discover how embeddings power modern search and recommendation systems with LLMs, using case studies from the LLMOps Database. From RAG systems to personalized recommendations, learn key strategies and best practices for building intelligent applications that truly understand user intent and deliver relevant results.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Discover how embeddings power modern search and recommendation systems with LLMs, using case studies from the LLMOps Database. From RAG systems to personalized recommendations, learn key strategies and best practices for building intelligent applications that truly understand user intent and deliver relevant results.

Please read the full blog post here and the associated LLMOps database entries here.

]]> Building LLM Applications that Know What They're Talking About πŸ”“πŸ§  https://podcast.zenml.io/llmops-db-rag a02b1d19-dac5-4d2e-bf72-f9ed97ad5cda Tue, 03 Dec 2024 08:00:00 +0100 ZenML GmbH full 3 ZenML GmbH A conversation about the RAG entries in the ZenML LLMOps database 21:23 no Explore real-world applications of Retrieval Augmented Generation (RAG) through case studies from leading companies. Learn how RAG enhances LLM applications with external knowledge sources, examining implementation strategies, challenges, and best practices for building more accurate and informed AI systems. Please read the full blog post here (www.zenml.io/blog/building-llm-applications-that-know-what-theyre-talking-about) and the associated LLMOps database entries here (https://zenml.io/llmops-database). rag, llmops, llms, ai, mlops, genai Explore real-world applications of Retrieval Augmented Generation (RAG) through case studies from leading companies. Learn how RAG enhances LLM applications with external knowledge sources, examining implementation strategies, challenges, and best practices for building more accurate and informed AI systems.

Please read the full blog post [here](www.zenml.io/blog/building-llm-applications-that-know-what-theyre-talking-about) and the associated LLMOps database entries here.

]]> Explore real-world applications of Retrieval Augmented Generation (RAG) through case studies from leading companies. Learn how RAG enhances LLM applications with external knowledge sources, examining implementation strategies, challenges, and best practices for building more accurate and informed AI systems.

Please read the full blog post [here](www.zenml.io/blog/building-llm-applications-that-know-what-theyre-talking-about) and the associated LLMOps database entries here.

]]> Demystifying LLMOps: A Practical Database of Real-World Generative AI Implementations https://podcast.zenml.io/demystifying-llmops 0e9f1c42-f2a3-471e-81c5-7bf31b3490f2 Mon, 02 Dec 2024 10:00:00 +0100 ZenML GmbH full 3 ZenML GmbH NotebookLM summary podcast episode of a ZenML blog around the LLMOps Database. 15:02 no The LLMOps Database offers a curated collection of 300+ real-world generative AI implementations, providing technical teams with practical insights into successful LLM deployments. This searchable resource includes detailed case studies, architectural decisions, and AI-generated summaries of technical presentations to help bridge the gap between demos and production systems. Please read the full blog post here (https://www.zenml.io/blog/demystifying-llmops-a-practical-database-of-real-world-generative-ai-implementations) and the associated database entries here (https://zenml.io/llmops-database). llmops,mlops,ai,llms,genai,production The LLMOps Database offers a curated collection of 300+ real-world generative AI implementations, providing technical teams with practical insights into successful LLM deployments. This searchable resource includes detailed case studies, architectural decisions, and AI-generated summaries of technical presentations to help bridge the gap between demos and production systems.

Please read the full blog post here and the associated database entries here.

]]> The LLMOps Database offers a curated collection of 300+ real-world generative AI implementations, providing technical teams with practical insights into successful LLM deployments. This searchable resource includes detailed case studies, architectural decisions, and AI-generated summaries of technical presentations to help bridge the gap between demos and production systems.

Please read the full blog post here and the associated database entries here.

]]>