Skip to content
Ankit Mohan Pandey / Senior Data EngineerBuild thoughtfully. Stay curious.

Reliable data.
Intelligent possibilities.

I'm Ankit, a senior data engineer building streaming and batch platforms. My focus is reliable systems, thoughtful trade-offs, and data people can trust. My curiosity is in what comes next: AI-driven applications, emerging tools, and turning new ideas into something useful.

Always learning. Currently exploring
data foundations for AI, retrieval-augmented generation, AI agents & workflow automation, evaluation, reliability & cost, real-time data for intelligent applications, emerging tools & industry use cases
Inside the work01 / Streaming
flink-agg · DEMO
parallelism 4
semantics
event-time
delivery
exactly-once
on failure
replay · DLQ

An illustrative event stream. A small window into the systems I work on — not live production telemetry.

what I do

Areas I go deep on

01

Streaming

Event-time semantics, watermarking, windowing and state management — stay correct when data arrives late, out of order, or twice.

stack
Apache BeamApache FlinkDataflowPub/SubKafka
02

Batch & warehousing

Partitioned, clustered models in BigQuery with an eye on query cost, plus the orchestration that keeps them fresh and reliably backfillable.

stack
BigQueryAirflowdbt-style modellingSQL
03

Reliability

Checkpointing, replay, idempotent sinks and dead letter queues — plus the alerting that makes a 3am page actionable instead of terrifying.

stack
CheckpointsDLQsReplayObservability
04

Platform

Reproducible local environments and CI, so a new engineer runs the whole stack on day one rather than week two.

stack
GCPDockerGitHub ActionsTerraform-style IaC
selected work

Things I've built

2026
streaming

01Flink event-time aggregation pipeline

A Kafka-to-Kafka streaming job doing 10s tumbling event-time windows with bounded out-of-orderness watermarks, checkpointing, and a side-output dead letter queue for late and malformed records. Fully containerised so it runs with one command.

Apache FlinkKafkaJavaDocker Compose