Open-source systems and LLM tooling developer based in Lucknow, India. I build reliable Rust and TypeScript systems, and I contribute focused fixes upstream.
Open to remote full-time, contract, and relocation-supported software roles.
Portfolio | LinkedIn | StackIntercept | Email
A Rust proxy for OpenAI-compatible LLM APIs with exact and semantic caching, reactive failover, Prometheus metrics, and tenant isolation. The repository has 38 Rust tests and 79 assertion macros. It is designed for teams that want to inspect cache behavior and upstream failures without moving prompts outside their own deployment.
A local-first CI evaluation engine and pre-commit gate built in Rust. It catches missing environment variables, schema drift, and broken LLM output contracts before merge using Git-diff scoped AST scanning and strict JSON Schema validation.
An agent spend-control prototype that enforces per-agent, per-window USDC limits in code. Its five local suites contain 31 passing tests across policy, Monad, Arc, BSC, and control-plane paths. It is prototype work, not a deployed financial product.
Static analysis tooling for Solana programs. It detects 10 documented vulnerability classes and is intended as a practical security-review aid.
20 merged pull requests across 18 organizations, including:
| Repository | Merged contribution |
|---|---|
| DataDog/guarddog | Rust/crates.io support for supply-chain malware scanning |
| tailscale/hujson | Parser handling for ambiguous Unicode line separators |
| getsentry/tacos-gha | Regression fix for a deletion-path KeyError in CI workflows |
| open-telemetry/opentelemetry-python | Bounded resource-detector waits to configured timeout |
| nushell/nushell | Error-stream propagation across pipeline commands |
| temporalio/sdk-typescript | Preserved zero-value optional durations in workflow dispatch |
| grafana/gcx | Safer environment-credential behavior after OS keychain lookup failure |
- Why Async SSE Streaming Collapses Reverse Proxy Connection Pools (and How to Fix It in Rust) — Deep architectural teardown on LLM token streaming, client disconnection TCP socket leaks, and backpressure handling with Tokio & Axum.
- 20 Merged PRs Across 18 OSS Organizations: A Deep Dive into Real-World Upstream Engineering — Detailed catalog of root causes, fixes, and lessons from Datadog, Tailscale, Sentry, OpenTelemetry, Temporal, and Grafana.
- Silent Cache Poisoning in LLM Streaming Proxies — How transient upstream stream truncation corrupts exact/semantic caches on HTTP 200, and how to enforce completion invariants.
I also have active contributions in flight for projects including LiteLLM, OpenTelemetry, Grafana, and Sentry.
- Rust, TypeScript, Node.js, Python, Go
- Async services, HTTP/SSE streaming, API design, testing, debugging
- PostgreSQL, Redis, Docker, Prometheus, Linux, GitHub Actions
- LLM gateway patterns, caching, failover, and observability
- Email:
sidsri1502@gmail.com - X: @SidSri0228
- LinkedIn: siddharth-srivastava