
System Design for the LLM Era: Patterns and principles for production-grade AI architecture
Author(s): Sampriti Mitra (Author)
- Publisher: Packt Publishing
- Publication Date: June 29, 2026
- Language: English
- Print length: 272 pages
- ISBN-10: 1807789934
- ISBN-13: 9781807789930
Book Description
STOP building fragile AI wrappers; START designing resilient AI systems.
Key Features
- From LLM fundamentals to real-world practicalities
- Patterns and principles for architecting LLM-based systems
- Learn from in-depth case studies
- Decouple from premium models using tiered fallback
- Event-driven architectures for decoupling high-latency agentic workflows
- Cost management approaches
- Security strategies for LLM systems
- Glossary of LLM and AI systems design terminology included
Book Description
Many companies are trying to turn their small AI experiments into big products, but they lack a good plan.
Engineers need a practical guide to building these new AI systems the right way, so that they can handle scale, won't cost too much to build or operate, and perform reliably.
This book is that guide, combining technical depth with breadth and practicality. Starting from LLM fundamentals, the book details the architectural patterns and design principles needed to build production-grade AI systems. In-depth case studies then show you how to apply them to a range of real-world application scenarios, including AI-native IDEs, adaptive learning platforms, and intelligent search solutions.
The book provides a deep, practical look at the real-world challenges and solutions for building systems with LLMs at their core.
What you will learn
- Architect a complete, production-grade AI-powered system from scratch
- Design and mitigate the unique challenges of LLM APIs, like high latency and cost
- Implement key software engineering patterns like circuit breakers and rate limiting for AI systems
- Choose the right databases and data models for AI applications, including vector search engines
- Build a scalable and resilient system that can handle high load and ensure user privacy
Who this book is for
This book will be an invaluable learning resource for engineers, architects and leads working with LLMs or looking to integrate LLMs into their existing systems.
Table of Contents
- Atomic Units of LLM Systems
- Core Architectural Patterns for LLM System Design
- Case Study: Designing AI-Native IDEs
- Case Study: Adaptive Learning Platform
- Case Study: AI-Powered Search for E-Commerce Platforms
- Case Study: AI-Powered Customer Support Agent
- Glossary
Editorial Reviews
About the Author
Sampriti Mitra is a software engineering lead and an alumna of IIT BHU, with over six years of experience designing and building scalable distributed systems. She understands the practical challenges of integrating large language models (LLMs) into production-grade systems. Her professional background includes roles at industry-leading companies like Sumologic and Razorpay. She also runs a newsletter, Architecturally Speaking, which is dedicated to breaking down system design principles.
{"@context":"https://schema.org","@type":"Book","name":"System Design for the LLM Era: Patterns and principles for production-grade AI architecture","image":"https://m.media-amazon.com/images/I/31j28qVMRLL._SX342_SY445_FMwebp_.jpg","author":{"@type":"Person","name":"Sampriti Mitra (Author)"},"publisher":{"@type":"Organization","name":"Packt Publishing"},"datePublished":"June 29, 2026","isbn":"9781807789930","numberOfPages":272,"inLanguage":"English","description":"STOP building fragile AI wrappers; START designing resilient AI systems.Key FeaturesFrom LLM fundamentals to real-world practicalitiesPatterns and principles for architecting LLM-based systemsLearn from in-depth case studiesDecouple from premium models using tiered fallbackEvent-driven architectures for decoupling high-latency agentic workflowsCost management approachesSecurity strategies for LLM systemsGlossary of LLM and AI systems design terminology includedBook DescriptionMany companies are trying to turn their small AI experiments into big products, but they lack a good plan.Engineers need a practical guide to building these new AI systems the right way, so that they can handle scale, won't cost too much to build or operate, and perform reliably. This book is that guide, combining technical depth with breadth and practicality. Starting from LLM fundamentals, the book details the architectural patterns and design principles needed to build production-grade AI systems. In-depth case studies then show you how to apply them to a range of real-world application scenarios, including AI-native IDEs, adaptive learning platforms, and intelligent search solutions.The book provides a deep, practical look at the real-world challenges and solutions for building systems with LLMs at their core.What you will learnArchitect a complete, production-grade AI-powered system from scratchDesign and mitigate the unique challenges of LLM APIs, like high latency and costImplement key software engineering patterns like circuit breakers and rate limiting for AI systemsChoose the right databases and data models for AI applications, including vector search enginesBuild a scalable and resilient system that can handle high load and ensure user privacyWho this book is forThis book will be an invaluable learning resource for engineers, architects and leads working with LLMs or looking to integrate LLMs into their existing systems.Table of ContentsAtomic Units of LLM SystemsCore Architectural Patterns for LLM System DesignCase Study: Designing AI-Native IDEsCase Study: Adaptive Learning PlatformCase Study: AI-Powered Search for E-Commerce PlatformsCase Study: AI-Powered Customer Support AgentGlossary","url":"https://www.amazon.com/dp/1807789934/","bookFormat":"http://schema.org/EBook","additionalType":"http://schema.org/PDF","fileSize":"34 MB","accessibilityFeature":["login required","member access only"],"accessibilitySummary":"PDF version available to authenticated members only. File size: 34 MB."}
电子书百科大全
评论前必须登录!
立即登录 注册