Hello World! I'm Avraham Shaked

DevOps · Data Engineering · AI · FinOps · Performance

I build and operate production systems end to end — from big-data infrastructure and pipelines to AI workflows, cost engineering and the dashboards that make it all observable — then share the decisions behind them.

Core skills: AI · Data Engineering · Kubernetes · Spark · Airflow · AWS · Python · Bash

Projects

All repos →

Things I've built and shipped. More on the way as I open-source them.

sql-replay pipeline overview: three stages — capture from slow query log or tcpdump pcap, replay against a MySQL 8.0 candidate, compare p50/p95/p99 latency deltas — ending in exit 0 pass / exit 2 regressed verdicts

sql-replay — MySQL Query-Replay Benchmarker

A multi-threaded MySQL benchmarking CLI in Rust, built to de-risk a real production MySQL 5.7 → 8.0 migration. It captures real query traffic from slow query logs or raw tcpdump pcap, replays it concurrently against a candidate server with bounded memory, and statistically compares per-query-fingerprint latency — plus result-correctness checksums — in HTML/JSON reports. Battle-tested in 5.7-vs-8.0 campaigns that caught and quantified genuine 8.0 regressions before cutover.

Rust · MySQL · Benchmarking · pcap · Open source

View on GitHub

Live demo

Market-Stream — Event-Driven Pipeline

A production-grade streaming pipeline: live stock quotes flow through Redpanda (Kafka) into Spark Structured Streaming, which lands exactly-once raw quotes and idempotent 1-minute OHLCV/VWAP rollups in an Apache Iceberg lakehouse on Kubernetes. The demo shows the live tape, rollups and a price chart updating in real time — and degrades gracefully to a recorded feed so it's never broken.

Kafka · Spark · Apache Iceberg · Kubernetes · Streaming

Open demo Code

Demo

Stocks Watchlist Dashboard

An interactive technical-analysis dashboard that scores a watchlist on a 0–100 composite signal — blending SMA trend, RSI, MACD and volume/VWAP — alongside a 52-week range, sparklines and a dark "trading terminal" UI. The public demo runs on synthetic data (real market feeds can't be publicly redistributed under provider terms), with the full indicator engine running on a Cloudflare Worker.

Cloudflare · JavaScript · Technical Analysis · Synthetic Data

Open

Videos

Visit channel →

I'm launching a channel on DevOps, FinOps and AI workflows — the first videos are in production.

Coming soon

YouTube channel — launching soon

Hands-on walkthroughs and teardowns: building real systems, cutting cloud cost, and wiring AI into day-to-day engineering workflows.

DevOps · FinOps · AI workflows · Performance

Visit channel

Articles

Long-form writeups live here as their canonical home, cross-posted to Medium and Dev.to. Benchmarks, cost breakdowns and architecture deep-dives.

We upgraded to MySQL 8: the same overnight jobs went from 12 hours on MySQL 5.7 to 30 hours on MySQL 8.0 — rolled back, built sql-replay, shipped on data.

We Upgraded to MySQL 8. Our Overnight Jobs Went From 12 Hours to 30.

A Friday MySQL 5.7 → 8.0 upgrade turned 12-hour overnight jobs into 30-hour ones — the rollback that followed, and how a weekend project became sql-replay, an open-source Rust replay engine.

MySQL · Rust · Performance

Read → Also on Medium

The modern cloud career I expected in 2022 versus the legacy system I actually inherited.

I Spent 4 Years Working on Legacy Systems

Cron jobs, tribal knowledge and an incident that lived in a five-year-old email thread — what four years of legacy big-data systems taught me about keeping things understood.

Legacy · Ownership · Engineering