Neoflex Reporting Big Data Edition at Big Data Conference 2018
Ruslan Sabitov – head of sector in the Department of Information Technologies of the National Clearing Center (NCC) –made a report at Big Data Conference 2018. He presented intermediate
Ruslan spoke on the first results of the project that saw all necessary infrastructure successfully deployed and reporting submitted to the Central Bank, all within 5 months. The cluster volume amounts to 400 TB, with 80% of data used for reporting has already been uploaded to the system. Generating a report, from the moment of close-of-business and starting the data loading until the final reports are received by the system, takes 25 minutes.
Thus, the major advantages gained by the customer when choosing a solution based on Big Data technologies are the following:
- Quick reporting preparation. HDFS (Hadoop) is used to store detailed data and Apache Spark is used for data processing and supports distributed in-memory calculations .
- Reduction of TSE (technical security equipment) in comparison to traditional solutions due to the use of open source software and possibility to install low-end hardware without loss of fault tolerance and performance.
Besides, the customer obtained a ready-made DataLake with financial information that can be used for analytics development tasks.
NCC functions as the clearing organization and the central counterparty in the Moscow Exchange markets. The principal task of NCC is to support of stability in the serviced segments of financial market due to the highly effective risk management system that meets the international standards.