eSolutions has implemented for Carrefour Romania a big-data platform with the purpose of optimizing the company’s operations. The platform aggregates information about stocks, prices, sales, promotions, orders, etc. from shops and warehouses all over the country.
Data is collected and processed in a centralized manner in order to be subsequently consumed by other systems and applications, through APIs, or transferred to external systems.
The big-data platform implemented for Carrefour increases performance and process scalability, has high availability to perform daily routine activities and facilitates access to data for the entire ecosystem of apps and IT systems. The platform supports product lifecycle automation through integrated technologies and increases the speed at which changes can be made, therefore contributing to the optimization of operations by decreasing data processing time.
With over 10,100 stores in 34 countries, the Carrefour Group is the world's second-largest retailer and number one in Europe. Every day, over 10 million customers visit Carrefour stores around the world, enjoying a wide range of products and services at affordable prices. In Romania, the Carrefour group offers its customers multiple shopping possibilities, both in stores or online, through the unique portal www.carrefour.ro or the BRINGO delivery service.
With the evolution of the company, business needs and technical requirements have increased. Thus, our partner was dealing with a series of challenges, such as: accumulating large volumes of data over time, as a result of increasing the number of stores; heterogeneous systems that were producing data; increasing data processing needs and transforming it into valuable information; the need to dramatically decrease the time in which data becomes available (real-time/ near real-time). Therefore, the client was facing difficulties in centralizing, processing, and transmitting data due to its large volume, inconsistency, and lack of standardization. Communication between applications and platforms was hampered by the complexity of the ecosystem and the inexistence of a standardized approach.
The big-data platform implemented for Carrefour gathers data from across 400 stores concerning 500.000 unique products, being updated and served to other applications in real-time. There are aggregated, among others, 35 million records that show the image of each product (stock, price, attributes, promotions, etc.) in all stores. Data flows processed in one day exceed 10 billion records.
The platform helps streamline and simplify internal processes, ensuring real-time access to data for the entire Carrefour application ecosystem, thus becoming a unique operational data source. For Carrefour customers, the entire process translates into improving the shopping experience through the eCommerce platform and product delivery services (Bringo).
The first phase of the project started at the end of 2017. Subsequently, new flows and features have been constantly developed, the project still being in progress. The project team is a complex one, including Big Data Solution Architects, Big Data Developers, Big Data Engineers, SysOps, Project Manager.
NiFi (for Data Ingest), HDFS (for Data Lake), Kafka Streams (for Event Sourcing), Spark (for Batch Processing), PostgreSQL, Redis, Cassandra, Druid (for Data Storage).