Topic / 36 articles
Blog posts in the AI ENGINEERING category
Separate predictions, policy, and execution with Jev and LangChain. Follow a refund through middleware, inspect review thresholds, and compare recorded decision latency with...
Carry authorization through retrieval, context, caches, and citations. Define trust boundaries, revocation behavior, and operational controls.
Separate retrieval coverage, context quality, and answer support. Calculate ranking metrics and design reproducible regression gates.
Separate schema validity, citation identity, and factual support; design bounded repair, honest abstention, and streaming behavior around those distinct guarantees.
Translate questions into bounded retrieval plans, preserve metadata constraints, and verify SQL result semantics with a worked incident-table example.
Work through reciprocal rank fusion, distinguish full-text search from BM25, and evaluate reranking and corrective retrieval without treating scores as confidence.
Turn retrieved candidates into useful context by preserving qualifiers, tracking expansion provenance, budgeting tokens, and separating image retrieval from visual answering.
Understand vector geometry, pin the full encoding contract, and evaluate approximate search under real filters before migrating an embedding index.
Design document ingestion around immutable representations, idempotent jobs, and atomic publication so failed updates cannot silently replace searchable evidence.
Compare chunk boundaries on the same source, preserve qualifiers and table structure, and evaluate retrieval against stable evidence rather than arbitrary chunk IDs.
Understand how RAG connects documents to an LLM: build an index, retrieve passages, assemble context, and return an answer with traceable sources.
A system-level guide to the twelve classic RAG failure modes, the techniques now used to address them, and the limits that still remain.
How two OpenUsage projects inspired me to investigate a Codex JSONL edge case and build a local-first dashboard for AI coding agents.
How to connect VS Code Copilot Chat to local OpenAI-compatible models served by LM Studio or Unsloth Studio, including the BYOK utility-model setting that prevents agent errors.
A practical mental model for KV cache memory, vLLM PagedAttention, SGLang RadixAttention, and prefill/decode disaggregation in modern LLM serving.
A reproducible CPU-only vLLM and LMCache workspace for understanding KV cache reuse, transfer modes, and local inference debugging on Apple Silicon.
How to use one local proxy to connect Databricks Model Serving to both VS Code Copilot Custom Endpoint and GitHub Copilot CLI.
How I use a Git ref as a local message channel between Claude Code and Codex for implementation, independent review, and iterative bug fixing.
A practical mental model for AI terminology: prompt, context, memory, agents, RAG, function calling, MCP, workflows, skills, and sub-agents.
Over the next 12 to 24 months, the differentiator among engineers will shift from mastery of programming languages like Rust, Go, or Python, or the volume of code produced, to the...
Reflection is related to agent self-improvement or reasoning feedback loops.
A LangGraph sample project with separate research, analysis, and supervisor services, REST communication, and retry handling.
LangGraph’s core philosophy is to orchestrate multi-step, stateful agent workflows using a directed graph (DAG or DG) structure. Each step is modeled as a node, while data and...
Currently, our different projects are using various MCP servers. To streamline and unify the process, we plan to implement a HUB MCP server that can handle multiple MCP Servers and...
LLM call is not stable and may fail due to network issues or other reasons, therefore, retry logic is necessary.
Compare stdio, SSE, and Streamable HTTP transports for MCP, with Python examples for configuring servers and clients.
A smolagents text-to-SQL example with query execution logs, answers from a receipts database, and tracing with Phoenix.
Beside the vscode extension hosts like (cline, continue), you can write your own client to connect to the MCP server. The client should be able to send and receive messages using...
Retrieval-Augmented Generation (RAG) is a powerful approach that combines retrieval and generation to produce high-quality responses. However, the quality of the final response can...
A collection of generative AI resources and project notes on schema mapping, feature engineering, PDF extraction, and agent frameworks.
Web crawling frameworks and a ScrapeGraphAI example that uses local Ollama models to extract structured information from a webpage.
Compare LangGraph and AutoGen across workflow structure, state management, customization, and use cases for LLM applications.
AutoGen is a framework for creating multi-agent AI applications that can act autonomously or work alongside humans.
Notes on processing unstructured PDF content and a demo architecture connecting a Gradio interface to models served by Ollama.
Now we can add our proxy config in our client, which will resolve connection issue.