Practical LLM Evaluation for Production Systems | Measure, monitor, and improve AI system reliability across training and inference
Lingua: inglese
Editore: Packt Publishing, 2026
- Brossura
- Nuovo
Da: preigu, Osnabrück, Germaniapreigu
Venditore AbeBooks dal 5 agosto 2024
Condizione: Nuovo
EUR 65,30
Quantità: 5 disponibili
Aggiungi al carrelloDescrizione dell’articolo da parte del venditore
Practical LLM Evaluation for Production Systems | Measure, monitor, and improve AI system reliability across training and inference | Ammar Mohanna (u. a.) | Taschenbuch | Englisch | 2026 | Packt Publishing | EAN 9781807423896 | Verantwortliche Person für die EU: Libri GmbH, Europaallee 1, 36244 Bad Hersfeld, gpsr[at]libri[dot]de | Anbieter: preigu Print on Demand.
Codice articolo 135855439
- Titolo
- Practical LLM Evaluation for Production Systems | Measure, monitor, and improve AI system reliability across training and inference
- Autore
- Ammar Mohanna (u. a.)
- Editore
- Packt Publishing
- Anno di pubblicazione
- 2026
- Condizione
- Neu
- Rilegatura
- Taschenbuch
- Lingua
- inglese
- ISBN 10
- 1807423891
- ISBN 13
- 9781807423896
- Peso dell'articolo
- 902 grammi
- Dimensioni
- 235 x 191 x 26 mm
- Cataloghi dei venditori
- Bücher
Build reliable Build reliable AI evaluation frameworks that measure quality, safety, grounding, and production readiness across modern LLM and SLM applications
Free with your book: DRM-free PDF version + access to Packt's next-gen Reader*
Key Features
- Design evaluation frameworks for LLMs, SLMs, multimodal, reasoning, and agentic AI systems
- Measure quality, safety, grounding, robustness, and production readiness with practical metrics
- Apply unified evaluation methods to text, multimodal, and agentic AI systems
Book Description
Modern AI systems are expected to do far more than generate fluent text. They should be able to retrieve information, reason through complex problems, understand images and documents, call external tools, execute workflows, and support critical business decisions. Evaluating these systems requires methods that go beyond traditional NLP benchmarks.
Taking a product-first approach, this book presents evaluation as a continuous operational capability spanning training, inference, and end-to-end system operation. You'll learn how to connect evaluation metrics directly to deployment gates, rollback criteria, monitoring systems, and production reliability objectives.
Using practical examples and real-world workflows, you'll explore evaluation strategies for text LLMs, vision-language models, multimodal conversational systems, mixture-of-experts architectures, reasoning models, agentic systems, retrieval pipelines, Text2SQL and Text2Cypher systems, embedding models, OCR workflows, and guardrail SLMs. You'll also learn how to manage non-determinism, design repeatable test suites, validate tool execution, and measure long-horizon agent behavior in production.
By the end of the book, you'll be able to design robust evaluation systems that help teams deploy reliable, safe, and economically viable LLM-powered applications with confidence.
*Email sign-up and proof of purchase required
What you will learn
- Design repeatable evaluation pipelines for LLM systems
- Assess inference quality, latency, and operational cost
- Evaluate multimodal, agentic, and reasoning AI systems
- Build regression gates and deployment evaluation workflows
- Detect hallucinations and grounding failures in VLMs
- Assess routing stability in mixture-of-experts models
- Evaluate Text2SQL, OCR, and retrieval-based systems
- Translate evaluation signals into production decisions
Who this book is for
ML engineers, GenAI engineers, AI architects, data scientists, platform engineers, and engineering managers responsible for deploying LLM-powered systems in production will benefit from this book. Applied AI researchers and technical decision-makers looking to measure reliability, safety, and operational readiness across modern AI systems will also find it valuable. Readers should have a working understanding of machine learning, Python, and modern LLM concepts.
Table of Contents
- Foundations of LLM Evaluation: Core Concepts and Primitives
- Building Reliable Text-Only LLMs Through Training-Time Evaluation
- Controlling Text-Only LLM Behavior at Inference Time
- Grounding and Reliability in Vision Language Models During Training
- Evaluating Visual Grounding and Reliability at Inference Time
- Evaluating Multimodal Conversational LLMs Across Training and Inference
- Evaluating Routing and Reliability in Mixture of Experts LLMs
- Evaluating Reliability and Control in Computer-Using Agent Systems
- Evaluating Information Extraction and Document-Understanding LLMs
- Evaluating Reasoning LLMs in Depth
- Evaluating Specialized LLM Systems
"Riassunto" può appartenere a un’altra edizione di questo titolo.
Informazioni sull’autore
Ammar Mohanna, PhD, is an AI and machine learning specialist based in Beirut, Lebanon. His work focuses on practical LLM systems, evaluation, MLOps/LLMOps, and applied generative AI. He teaches and consults on production AI, AI agents, and graph-based machine learning, with an emphasis on turning research ideas into reliable, usable systems for real-world teams.
Indrajit Kar comes with 18 years of various Industry experience, leading all three division, AI consulting R&D and solution engineering. He and his team build cutting edge AI and deep learning solutions to address some of the toughest problems for his customers. He has 14 research papers and 12 patents in NLP, Timeseries, Computer Vision, and Deep learning. In his spare time, Indrajit enjoys giving advice to small and medium-sized entrepreneurs on how to enter the AI and data science markets, attract customers, develop their products, and monetize their existing data. He's won many accolades in his career from ace innovator, services excellence awards, and 40 top data scientist under the age of 40 award. He has enabled AI & Data science program for sectors like Smart Cities, Retail, supply chain, automotive factories, Healthcare, pharma, infrastructure & utilities. Also heading research and development in the area of Deep learning, predictive maintenance using IIoT/sensor data, edgeAi, Lidar tech, NLP and GPU powered computer vision. In the past, he spearheaded complex Analytics projects helping industries like BFSI, Retail, CPG, FMCG, petroleum/oil & gas, to take data driven decision, predict business outcomes, allocate budget, predict customer behaviour, retention customers, acquire new customers, maximize revenue & forecasting for key areas Pricing, marketing, sale, advertisement and promotion.
Zonunfeli Ralte is an Artificial Intelligence entrepreneur, researcher, and technology leader. She founded RastrAI Private Limited, the first AI startup from India's North East region, advancing innovation in emerging technologies. Recognized as Mizoram's first woman specializing in Artificial Intelligence and Machine Learning, she has authored three books on Artificial Intelligence, Generative AI, and Computer Vision. She is also an accomplished researcher with 16 published research papers and six Best Research Awards, reflecting her significant contributions to Artificial Intelligence, Deep Learning, and applied AI innovation.
"Descrizione articolo" può appartenere a un’altra edizione di questo titolo.
preigu
Osnabrück, Germania
Venditore AbeBooks dal 5 agosto 2024
Tariffe di spedizione da Germania a U.S.A.
| Articolo | Da 60 a 60 giorni lavorativi | Da 60 a 60 giorni lavorativi |
|---|---|---|
| Primo articolo | EUR 70,00 | EUR 70,00 |
Metodi di pagamento
- PayPal
Descrizione dello Store
preigu betreibt einen Onlineversandhandel mit über 1 Mio. Produkten in verschiedenen Sortimenten. Das Kernsortiment besteht aus Büchern, Medien und Spielwaren. Ein gelungenes Einkaufserlebnis ist das Ziel einer jeden Bestellung bei preigu, denn der Kunde und seine Zufriedenheit stehen an erster Stelle. preigu setzt daher auf einen kompetenten Kundenservice, funktionierende Prozesse und schnelle Reaktion.
Specializzazione
Bücher, SpielwarenInformazioni sull’azienda del venditore
preigu GmbH & Co. KG
Lengericher Landstraße 19
Osnabrück, Germania 49078
Condizioni di vendita
About Us
Legal website operator identification:
preigu GmbH & Co. KG
Lengericher Landstr. 19
49078 Osnabrück
Germany
Telephone: +49 (0) 541 / 580 72 84
Email: mail@preigu.de
VAT No: DE 455 380 498
AG Osnabrück - HRA 209647
PhG: preigu Verwaltung GmbH
AG Osnabrück - HRB 221793
CEO: Ansas Meyer
We are neither willing nor obliged to participate in dispute resolution proceedings before consumer arbitration boards.
We are a member of the initiative "FairCommerce" since 30.11.2016.
For more information, see: https://www.haendlerbund.de/de/haendlerbund/interessenvertretung/faircommerce
Diritto di recesso
Instructions for revocation
Right of withdrawal for the sale of goods
Revocation right for consumers
(A ‘consumer' is any natural person who concludes a legal transaction which, to an overwhelming extent, cannot be attributed to either his commercial or independent professional activities.)
Instructions for revocation
Revocation right
You have the right to revoke this contract within 14 days without specifying any reasons.
The revocation period is 14 days with effect from the day,
-
on which you or a third party nominated by you, which is not the carrier, had taken possession of the products, provided you had ordered one or more products within the scope of a standard order and this/these product/products is/are delivered uniformly;
-
on which you or a third party nominated by you, which is not the carrier, had taken possession of the last product, provided you had ordered several products within the scope of a standard order and these products are delivered separately;
-
on which you or a third party nominated by you, which is not the carrier, had taken possession of the last part delivery or the last unit, provided you had ordered a product, which is delivered in several part deliveries or units;
To exercise your right of withdrawal, you must inform us (preigu GmbH & Co. KG, Lengericher Landstr. 19, 49078 Osnabrück, Telephone number: +49 (0) 541 / 580 72 84, E-Mail address: mail@preigu.de) by means of a clear declaration (e.g. a letter sent by post, or an e-mail) of your decision to withdraw from this contract. You can use the attached model withdrawal form for this purpose, which is, however, not mandatory.
You can also exercise your right of withdrawal online by clicking on a button labelled accordingly (such as ‘Withdraw from contract' or similar) on the AbeBooks/ZVAB website. If you use this online function, you will immediately receive a confirmation of receipt on a durable medium (e.g. via email) containing information on the content of the withdrawal notice, as well as the date and time of its receipt.
In order to safeguard the revocation period, it is sufficient that you send the notification about the exercise of the revocation right before the expiry of the revocation period.
Consequences of the revocation
If you revoke this contract, we shall repay all the payments, which we received from you, including the delivery costs (with the exception of additional costs, which arise from that fact that you selected a form of delivery other than the most reasonable standard delivery offered by us), immediately and at the latest within 14 days from the day on which we received the notification about the revocation of this contract from you. We use the same means of payment, which you had originally used during the original transaction, for this repayment unless expressly agreed otherwise with you; you will not be charged any fees owing to this repayment.
We can refuse the repayment until the products are returned to us or until you have furnished evidence that you have sent the products back to us, depending on whichever is earlier.
You must return or transfer the products to us immediately and, in any case, at the latest within 14 days with effect from the day on which you inform us of the revocation of this contract. The deadline is maintained if you send the products before the expiry of the 14 day deadline.
You bear the direct costs for returning the products.
You must pay for any depreciation of the products only if this depreciation can be attributed to any handling with you that was not necessary for checking the condition, features and functionality of the products.
Criteria for exclusion or expiry
The revocation right is not available for contracts
-
for delivery of products, which are not prefabricated and for whose manufacturing an individual selection or stipulation by the consumer is important or which are clearly tailored to the personal requirements of the consumer;
-
for delivery of products, which can spoil quickly or whose use-by date would be exceeded quickly;
-
for delivery of alcoholic drinks, whose price was agreed at the time of concluding the contract, which however can be delivered 30 days after the conclusion of the contract at the earliest and whose current value depends on the fluctuations in the market, on which the entrepreneur has no influence;
-
for delivery of newspapers, periodicals or magazines with the exception of subscription contracts. The revocation right expires prematurely in case of contracts
-
for delivery of sealed products, which are not suitable for return for reasons of health protection or hygiene if their seal has been removed after the delivery;
-
for delivery of products if they have been mixed inseparably with other goods after the delivery, owing to their condition;
-
for delivery of sound or video recording or computer software in a sealed package if the seal has been removed after the delivery.
Specimen - revocation form
(If you wish to revoke the contract, please fill up this form and send it back to us.)
-
To preigu GmbH & Co. KG, Lengericher Landstr. 19, 49078 Osnabrück, Email address: mail@preigu.de :
-
I/we () herewith revoke the contract concluded by me/ us () regarding the purchase of the following products ()/
the provision of the following service () -
Ordered on ()/ received on ()
-
Name of the consumer(s)
-
Address of the consumer(s)
-
Signature of the consumer(s) (only in case of a notification on paper)
-
Date
(*) Cross out the incorrect option.