Project overview
To reduce the costs of Splunk usage in its organization, our client decided to offload parts of log traffic via forwarder and store it in Hadoop in a queryable manner. Our team developed a reusable solution to handle different types of logs, ingest them, parse them and store them in a selected Big Data storage system, according top lanned data utilization.
Client background
A Polish bank that provides retail, corporate, investment banking, and other financial services. Our client is frequently recognized as one of the most innovative banks in Poland.
Goals
Creating a solution that handles large traffic volumes. Processing a wide variety of logs. Dealing with constantly changing log patterns across different log streams. Focusing on delivering a reliable solution and avoiding data loss.
