About

The Client is a leading market research company, providing comprehensive insights and analytics to help businesses make informed decisions.

Challenge

Though having a robust analytical system, the Client believed that it would not be able to satisfy the company s future needs. Acknowledging this situation, the Client was keeping their eyes open for a future-focused innovative solution. A system-to-be was to cope with the continuously growing amount of data, to analyze big data faster and enable comprehensive advertising channel analysis.

After deciding on the system s-to-be architecture, the Client was searching for a highly qualified and experienced team to implement the project. Satisfied with a long-lasting cooperation with VolgoTechnologies, the Client addressed our consultants to do the entire migration from the old analytical system to a new one.

Solution

During the project, the Client s business intelligence architects were cooperating closely with VolgoTechnologies big data team. The former designed an idea, and the latter was responsible for its implementation.

Amazon Web Services and Microsoft Azure were selected as cloud computing platforms. Upon the Client s request, during the migration, the old system and the new one were operating in parallel.

Staging

Data Ware House

Data Ware House

Desktop Application

Results

At the project closing stage, the new system was able to process several queries up to 100 times faster than the outdated solution. With the valuable insights that the analysis of almost 30,000 attributes brought, the Client was able to carry out comprehensive advertising channel analysis for different markets.

Technologies and Tools

Apache Hadoop, Apache Hive, Apache Spark, Python (ETL), Scala (Spark, ETL), SQL (ETL), Amazon Web Services (Cloud storage), Microsoft Azure (Cloud storage), .NET, WPF, C#.