Andrei started working at msg systems as a backend developer in the Automotive industry.
Driven by his passion for the Big Data world, he started introducing new technologies in our company’s projects.
His main activities revolve around building scalable cloud applications and big data processing pipelines,
whilst spreading his knowledge and experience amongst colleagues and other software enthusiasts.
Big Data on the Apache Hadoop Ecosystem
In times of IoT it is necessary to process huge amounts of data fast. The data must be ingested, stored, filtered, processed and analyzed.
Based on the discussion of the relevant architectural patterns we show how to build flexible BigData solutions in the Apache Hadoop ecosystem with Kafka, Spark and Storm.
We discuss data formats, batch and streaming scenarios, testing and deployment.