- BNP Paribas has now deployed an internal LLM as a Service platform, designed to provide the Group's entities with unified access to large-scale language models (Large Language Model - LLM) in a secure environment within the Group's own infrastructure.
- This shared infrastructure, operated by the Group's IT teams, is set to accelerate the development of generative artificial intelligence (AI) use cases to better serve employees and clients.
- This initiative is part of the Group's technology strategy, which leverages data and AI as key drivers to enhance customer personalization and operational performance.
To facilitate the development and deployment of generative AI use cases in its businesses and functions, BNP Paribas has designed and deployed an internal LLM as a Service platform.
Operated by the Group's IT teams, this technology, allows each entity to access a selection of language models (LLM) tailored to its needs via a standardized and secure interface. These models can be directly integrated into tools or processes.
The platform is based on a shared infrastructure hosted in the Group's data centers, equipped with specialized computing capabilities (GPU). It provides access to a selection of open-source models, models from Mistral AI, a partner of the Group, and soon models trained on internal datasets, according to specific needs.
This architecture allows the Group to have high processing power to efficiently execute language models, while sharing and limiting costs. The platform guarantees a secure deployment within the Group's infrastructure, in compliance with data privacy requirements, and strengthens the alignment of generative AI usage with the needs of businesses and functions.
« With LLM as a Service, we are creating a common technological foundation that allows entities to focus on business use cases, while relying on a shared and secure infrastructure. It is a common lever to innovate and improve the performance of certain applications. » Marc Camus, Group Chief Information Officer, BNP Paribas
Several generative AI use cases are already in production or experimentation within the Group's businesses, such as internal assistants, document generation, and information retrieval in documents.
The implementation of the platform allows for scaling up by facilitating the deployment of these use cases within a common framework and accelerating the implementation of new projects. The platform enhances the businesses’ ability to quickly integrate generative AI into their existing processes, with shared technical and security standards.
LLM as a Service was deployed in an initial test phase across various entities of the Group, such as Hello bank! and the Group's general inspection, and is intended to be progressively deployed across the Group according to an industrialization process. Additionally, generative AI already enables developers to create code as well as easily and centrally access development tools, AI technologies, and DevOps chains.
LLM as a Service builds on the feedback from the first user entities and complements the initiatives already undertaken around generative AI within BNP Paribas. This gradual deployment allows for the consideration of local specificities while ensuring a high level of security, compliance, and operational efficiency.
Leader in banking and financial services in Europe, BNP Paribas operates in 64 countries and has nearly 178,000 employees, including more than 144,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialised businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realise their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Türkiye, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability.