Live · Backend · Distributed Systems · SRE

SAURABH
PARTHE

Software Engineer · Distributed Systems · SRE

Building and operating production backend systems with Golang, Java, and Python. Specialising in distributed systems, Kubernetes, and Kafka — writing software that is reliable, observable, and built to scale.

1000+
Concurrent Streams
<50ms
p99 Latency
99.99%
Uptime
600+
LeetCode Solved
Scroll · Explore Architecture
02 / Featured Projects

Production-grade infrastructure, end-to-end.

Each project is a complete distributed system — designed, deployed, monitored, and tuned for real workloads. Architecture decisions, metrics, and trade-offs included.

Edge AI · Computer VisionProduction
View on GitHub

Distributed Video Intelligence Platform

Real-time video analytics platform that processes concurrent camera streams through a bounded goroutine worker pool, runs AI threat detection via a FastAPI inference service, and publishes events to Kafka — with automatic backpressure under load.

Built in Go with a Sarama Kafka producer (Snappy compression), Redis per-camera state with 30-second TTL, and a Python FastAPI inference service running mock CNN analysis at 45ms p99. Goroutine pool drops frames gracefully under backpressure rather than blocking the ingestion path.

1000+
Concurrent Streams
< 45ms
Inference p99
30 fps
Frame Rate
30K msg/s
Throughput

Engineering Features

  • Bounded goroutine worker pool — configurable concurrency limit
  • Frame-drop backpressure: never blocks producers under overload
  • 45ms context timeout per AI inference round-trip
  • Per-camera Redis state with 30-second TTL
  • Sarama SyncProducer with Snappy compression to Kafka
  • Prometheus: frame throughput, latency histograms, threat event counts

Architecture

  • N camera goroutines → bounded channel (backpressure gate)
  • Worker pool: goroutines with 45ms timeout context per frame
  • Python FastAPI: /analyze endpoint — mock CNN, 5% threat rate
  • Sarama SyncProducer → Kafka topic (Snappy)
  • Redis hot store: camera-state:<id>, 30s TTL per camera

Stack

GoKafkaRedisPythonFastAPIPrometheusDockerKubernetes
Open repository on GitHub
04 / Experience

Engineering across edge AI, FinTech, and ML systems.

Three industries, one through-line: building distributed systems that hold up under real-world traffic, failure modes, and scale.

01 · Backend · Edge AI · Distributed Systems

Software Engineer (SDE-1)

@ SkylarkLabs

Nov 2025 — Present
  • Built a distributed Go pipeline processing 1,000+ concurrent RTSP streams through gRPC, NVIDIA Triton Inference Server with dynamic batching, and WebRTC egress, sustaining sub-50ms end-to-end latency.
  • Engineered production HLS/fMP4 video chunking with IDR-gated segment boundaries, in-memory ring buffer, and async MinIO/S3 upload for gap-free seekable archives — the architecture behind YouTube and Netflix.
  • Architected 11 AI detection workloads (ANPR, FOD, fire/smoke, PPE, intrusion) as independent Kubernetes microservices on NVIDIA Triton with gRPC/Protobuf contracts and NATS-based multi-tenant alert delivery.
  • Built edge-to-cloud control plane multiplexing drone telemetry over yamux, with NVENC/VAAPI hardware encoding, signed-URL auth, and MediaMTX for multi-tenant RTSP/WebRTC live stream delivery at scale.
GolangTritongRPCKubernetesNATSWebRTCHLS/fMP4MinIOyamuxProtobufNVENC/VAAPI
02 · FinTech · Backend · Event-Driven Systems

Software Engineer

@ NeoXam

May 2025 — Nov 2025
  • Developed and shipped financial transaction microservices on Spring Boot
  • Designed and maintained REST APIs and internal service contracts for settlement workflows
  • Built Kafka event-driven processing pipelines for real-time claims and settlement
  • Integrated ElasticSearch for high-cardinality financial data search and aggregations
  • Deployed fault-tolerant services across AWS regions with multi-AZ high availability
  • Optimized pricing pipelines processing millions of financial events daily
JavaSpring BootKafkaElasticSearchAWSMySQL
03 · ML · Backend Development

Software Engineer Intern

@ Seven Mentor

Aug 2023 — Aug 2024
  • Built backend services and REST APIs integrating ML-powered recommendation features
  • Developed end-to-end data pipelines from ingestion to model training and serving
  • Wrote feature engineering workflows and operationalized predictive models with XGBoost
  • Contributed to anomaly detection modules running on streaming data
  • Gained hands-on exposure to production ML pipelines and software delivery processes
PythonXGBoostTensorFlowFastAPIPandasScikit-learn
05 / Tech Stack

Tools chosen for the workload — not for the resume.

A focused stack covering the full distributed systems lifecycle — from streaming and orchestration to ML serving and observability.

LanguagesExpert

Golang

LanguagesExpert

Python

LanguagesAdvanced

Java

LanguagesAdvanced

TypeScript

Distributed SystemsExpert

Kafka

Distributed SystemsExpert

gRPC

Distributed SystemsAdvanced

NATS

Distributed SystemsExpert

Event-Driven Architecture

Distributed SystemsAdvanced

CQRS / Event Sourcing

Distributed SystemsExpert

System Design

Distributed SystemsExpert

Microservices

Distributed SystemsAdvanced

Service Mesh

Cloud NativeExpert

Kubernetes

Cloud NativeExpert

Docker

Cloud NativeAdvanced

AWS

Cloud NativeAdvanced

Helm

Cloud NativeAdvanced

Terraform

AI / MLAdvanced

TensorFlow

AI / MLAdvanced

PyTorch

AI / MLExpert

Prompt Engineering

AI / MLAdvanced

LLM Systems

AI / MLAdvanced

XGBoost

AI / MLExpert

AI Infrastructure

DataExpert

PostgreSQL

DataExpert

Redis

DataAdvanced

ElasticSearch

DataAdvanced

ClickHouse

DataAdvanced

Spark

DataAdvanced

MySQL

ObservabilityExpert

Prometheus

ObservabilityExpert

Grafana

ObservabilityAdvanced

OpenTelemetry

ObservabilityExpert

Distributed Tracing

FrameworksAdvanced

Spring Boot

FrameworksExpert

FastAPI

FrameworksAdvanced

Next.js

FrameworksAdvanced

React

06 / Engineering Metrics

Operational numbers, not vanity numbers.

The metrics below describe the systems I've owned in production — what they handled, what they delivered, and what they survived.

Concurrent Streams
0+

Live camera feeds processed in real time.

End-to-End Latency
0ms

Sub-50ms inference pipelines under load.

Uptime
0.00%

Across distributed production systems.

LeetCode Problems
0+

Solved across DS, graphs, DP, and concurrency.

Events Processed Daily
0M+

Across event-driven backend platforms.

Microservices Owned
0+

Across Golang, Java, and Python stacks.

07 / Research & Writing

Distributed systems, written down.

Deep dives and engineering notes on the systems-level topics I work in every day. Click any note to read the full article.

08 / About

Engineering for systems that think.

I build infrastructure for the kind of systems that have to be right, fast, and observable at the same time. Distributed by default. Intelligent where it matters.

My work sits at the intersection of distributed systems and AI infrastructure — the layer where latency budgets, fault tolerance, and model behavior all collide. I've built platforms that process thousands of real-time camera streams, financial event pipelines clearing millions of daily transactions, and predictive systems that catch infrastructure failures before they happen.

I care about the parts that don't demo well: backpressure, idempotency, replay semantics, observability, and the operational hygiene that makes 99.99% a sustained number — not a screenshot. Production is the only review that matters.

Outside of work, I'm a long-form thinker on system design, a competitive problem-solver (600+ LeetCode), and a believer that the next decade of AI will be won at the infrastructure layer — not the model layer.

Distributed SystemsAI InfrastructureReliability EngineeringSystem DesignEvent-Driven

Systems Thinking

Engineering decisions ripple — through latency, cost, on-call burden, and team velocity. I optimize for the whole graph, not the local edge.

Scalable Architecture

Designs that hold their shape under 10x load. Bounded contexts, idempotent paths, explicit failure modes — by design, not by accident.

AI Infrastructure

ML lives or dies on the systems around it. Feature pipelines, model serving, GPU economics, and observability are the real product.

Distributed Computing

CAP-aware design, replication topologies, consensus where required, eventual consistency where it suffices — chosen, not assumed.

Clean Architecture

Domain logic separated from transport, storage, and frameworks. Code that can be tested without infrastructure and replaced without rewrites.

Reliability Engineering

SLOs that mean something, error budgets that get respected, runbooks that are written before the incident — not during it.

09 / Contact

Let's build the infrastructure layer of intelligent systems.

Available for software engineering roles across backend, distributed systems, and SRE — and open to advisory work and high-leverage engineering collaborations.