Categories data-pipeline

2 posts

Auto Added by WPeMatico

Apache Spark Streaming Simplified

A typical spark streaming data pipeline. The above data flow depicts a typical streaming data pipeline used for streaming data analytics. OK Lets split it up, You need a source and in this example I will use a delimited file as a source for the Kafka topic.There are multiple ways […]

Quest to understand Machine Learning in Production & Notes Part II

Continuing from the Part I of this quest. This piece will take a deep dive into Martin Zinkevich’s work. These rules are very tactical and presumes a high degree of familiarity with building machine learning driven products.To be frank, after thoroughly going through the document, a lot of the rules […]