Our customer is fast growing advertisement company with many business areas generating terabytes of data daily.
Project requirement was to consolidate all sources and build comprehensive BigData platform capable to process high volumes of data simply and efficiently.
To address problem Zentaly team designed Domain Specific Platform providing clients well known domain entities which could be used as foundation to build higher layers for data visualisation and reporting.
This approach let us build simple and versatile flows without wasting time on technical details of data persistence and pooling.
System requirements:
- Terabytes of data processed daily
- Linear scalability
- Unified fully fledged architecture to correspond multiple business areas
Technologies Stack:
- Scala
- Cloudera Hadoop
- Spark
- Flume
- Slick