Skip to main content

3 posts tagged with "Observability"

View All Tags

RAG Pipeline Utils v3.5: Checks You Can Measure, See in Your Traces, and Run on the Model's Own Citations

· 6 min read
Ali Kahwaji
Creator & Maintainer of RAG Pipeline Utils

v3.5.0 is about trusting the checks. The guards take a model of your choice for what patterns miss, and the patterns' accuracy is now published, misses included. Evaluation scores show up in OpenTelemetry and Langfuse, on the spans they judge. And when Claude or OpenAI file search cites its sources, verifyCitations() checks that each cited passage actually says what the sentence claims. Nothing breaks for existing code.

npm install @devilsdev/rag-pipeline-utils@^3.5.0

RAG Pipeline Utils v2.7.1: Clearer Errors and Correct Metrics

· 3 min read
Ali Kahwaji
Creator & Maintainer of RAG Pipeline Utils

v2.7.1 is a small patch for the observability and error helpers. createError now gives every error code its own message, metrics no longer hand back the wrong kind of metric or lose error counts, and the event logger's constants cover every event it records. Nothing in the pipeline itself changes.

npm install @devilsdev/rag-pipeline-utils@2.7.1