<oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd"><dc:title>A UNIFIED PIPELINE ARCHITECTURE FOR ENTERPRISE-READY LLMs: ADAPTIVE INGESTION, CONTINUAL LEARNING, SLO-AWARE RETRIEVAL, AND AUTOMATED FEEDBACK CONVERGENCE</dc:title><dc:creator>Raza, Muhammad Faizan</dc:creator><dc:subject>Large Language Models</dc:subject><dc:subject>LLM Pipeline Architecture</dc:subject><dc:subject>Retrieval-Augmented Generation</dc:subject><dc:subject>Continual Learning</dc:subject><dc:subject>Catastrophic Forgetting</dc:subject><dc:subject>Adaptive Ingestion</dc:subject><dc:subject>SLO-Aware Retrieval</dc:subject><dc:subject>Feedback Orchestration</dc:subject><dc:subject>Error Fingerprinting</dc:subject><dc:subject>Self-Correction</dc:subject><dc:subject>LoRA Adapters</dc:subject><dc:subject>Sparse Temporal Adapter Routing</dc:subject><dc:subject>Knowledge Staleness</dc:subject><dc:subject>Hallucination Mitigation</dc:subject><dc:subject>MAPE-K Control Loop</dc:subject><dc:subject>Stream Processing</dc:subject><dc:subject>Apache Kafka</dc:subject><dc:subject>Neighborhood-Distilled Correction Exemplars</dc:subject><dc:subject>Enterprise AI</dc:subject><dc:subject>LLMOps</dc:subject><dc:coverage>Data Analytics</dc:coverage><dc:relation>MS</dc:relation><dc:description>Large Language Models have rapidly transitioned from research prototypes to indispensable components of enterprise systems across finance, healthcare, emergency response, and real-time analytics. Yet the operational realities of production deployment expose four fundamental limitations that current architectures fail to address in combination: knowledge staleness caused by static pretraining cutoffs, catastrophic forgetting during parameter updates, hallucinated outputs that undermine factual reliability, and weak feedback mechanisms that allow systematic errors to persist without automated correction. Addressing these limitations in isolation, as the prior literature has almost exclusively done, is insufficient. Each failure mode interacts with and amplifies the others: stale knowledge makes retrieval less effective, imprecise retrieval makes hallucination more likely, and the absence of a closed-loop correction mechanism means that neither failure is caught before it reaches the user. This thesis takes the position that these four problems constitute a single engineering discipline and proposes a unified, six-layer pipeline architecture grounded in classical software design patterns to address all four simultaneously.
The research is organized around four guiding questions. The first asks which real-time ingestion architecture, among Pure-Stream, Lambda, and CQRS patterns, best minimizes the end-to-end latency from data arrival to LLM-answerable freshness, leading to the Adaptive Ingestion Pattern Orchestrator (AIPO) and the Answerability Tracing Protocol (ATP), the first reproducible benchmark for measuring time-to-answerable freshness in LLM pipelines. The second asks how to update model parameters continuously without catastrophic forgetting under realistic compute and memory budgets, leading to STAR+FAR: Sparse Temporal Adapter Routing combined with Freshness-Aware Replay, a continual learning regimen that routes each query through a sparse weighted combination of per-day LoRA adapters while maintaining a hardness-novelty-recency-prioritized replay buffer of 128 examples. The third asks how retrieval-augmented generation can be optimized to meet strict service-level objectives simultaneously on accuracy, latency, and cost, leading to SAGE: a lightweight SLO-aware retrieval budget policy that learns, via oracle-guided imitation, to dispatch each query to its individually optimal retrieval depth k rather than applying a fixed budget to all queries. The fourth asks whether a closed-loop feedback controller can learn from oracle-demonstrated remediation choices to produce net-positive quality correction on real LLM outputs without human intervention, leading to CAFO: the Convergence-Aware Feedback Orchestrator, which combines error fingerprinting, neighborhood clustering, and a LightGBM selector trained on oracle decisions to issue targeted remediations that are validated by a sequential A/B test before being committed.
The experimental campaign spans 1,620 pipeline variant runs across four LLM families, three benchmark datasets, and two hardware scales, accumulating approximately 400 A100 GPU hours. The results verify all four hypotheses. On RQ1, Pure-Stream achieves a P95 time-to-retrieval-ready latency of 117 milliseconds, 4.3 times lower than the CQRS baseline of 499 milliseconds, and AIPO improves burst resilience by 38 percent over any static architecture. On RQ2, STAR+FAR simultaneously achieves a 4.1 percentage point gain in factual freshness and a 3.2 percentage point gain in legacy retention relative to the best prior baseline, a Pareto improvement that no single-mechanism continual learning approach achieves, confirmed at both TinyLlama 1.1B on CPU and Qwen2.5-7B on GPU at 1.7 minutes per day update cost. On RQ3, SAGE achieves 95 percent SLO compliance compared to 30 percent for the best static retrieval configuration, a 36 percent reduction in P95 latency, and a 51 percent reduction in retrieval cost, while generalizing zero-shot across all four LLM families tested. On RQ4, CAFO achieves the only non-negative mean cumulative correction efficiency among five feedback regimens on the primary benchmark, and its trained selector transfers to a held-out model architecture with a cumulative correction efficiency of +0.329, the strongest single corrective result in the campaign, demonstrating that error fingerprint patterns encode failure-mode structure that is largely model-agnostic.
Taken together, these contributions constitute the first unified, empirically validated framework for real-time enterprise LLM pipelines in which each architectural layer is optimized not merely in isolation but in explicit service of its neighbors, creating a virtuous cycle in which faster ingestion sharpens the continual learning signal, more accurate parametric knowledge reduces the retrieval burden, cost-efficient retrieval liberates headroom for denser feedback correction, and net-positive automated feedback closes the quality loop that all three preceding layers leave open. The work elevates LLMOps from ad-hoc engineering to a principled, reproducible discipline, delivering a strategic pipeline blueprint that maps business constraints directly to empirically validated architectural choices for practitioners building systems that must be fast, fresh, factual, and self-improving, all at the same time.
</dc:description><dc:contributor>Satish Mahadevan Srinivasan, Thesis Advisor/Co-Advisor</dc:contributor><dc:contributor>Chengfei Wang, Committee Member</dc:contributor><dc:contributor>Raghu Sangwan, Program Head/Chair</dc:contributor><dc:contributor>Hajime Shimao, Committee Member</dc:contributor><dc:contributor>Dusan Ramljak, Committee Member</dc:contributor><dc:rights>open_access</dc:rights><dc:date>2026-03-25T03:24:05Z</dc:date><dc:identifier>https://etda.libraries.psu.edu/catalog/35191mfr5933</dc:identifier></oai_dc:dc>