Gurdit Singh

basics of Kafka Streams: Episode 1

25 Feb 2021

Kafka Streams is a library for building streaming applications, specifically applications that transform input Kafka topics into output Kafka topics More …

Working with Joins in Spark Structured Streaming

18 Feb 2021

Spark Structured Streaming handles various types of joins with both static and streaming datasets More …

Handling Late Data Using Watermarking in Spark Structured Streaming

17 Feb 2021

what happens if one of the events arrives late to the application and we apply window-based grouping More …

Working with Window Aggregations in Spark Structured Streaming

15 Feb 2021

In Streaming appliction rather than running aggregations over the whole stream, you want aggregations over subset of data by time windows (say, every 5 minutes or every hour) More …

Concept of Time in Spark Structured Streaming

10 Feb 2021

Time in streaming application is way to correlate different events in the stream to extract some meaningful insights. More …