Skip to main content
FinanceDataArchitecture
BNPPARIBAS

When the success of a marketplace creates more chaos than the failure it was meant to prevent

Before

15

out-of-sync repositories, millions of orphaned artifacts

After

€2.5M

saved

€2.5M

saved

15

reference data repositories synchronized

3

continents covered

In 2016, BNP Paribas CIB launched an IT services marketplace to modernize access to internal cloud resources. The bet paid off too fast: adoption was so strong that the scope extended to every business line, every service, every continent. Thousands of employees consumed its services from Paris, New York and Singapore. Millions of artifacts were generated. And somewhere in that abundance, 15 data repositories started telling different stories.

SITUATION BEFORE

Operational baseline
15 reference data repositories silently diverging, millions of artifacts provisioned without coordinated governance, each participating provider with its own naming conventions and life cycles.
Teams affected
150 direct users of the platform in Paris, New York and Singapore, and thousands of employees consuming its services, all working from potentially inconsistent data depending on their location.
Hidden costs
€2.5M identified in costs linked to out-of-sync repositories and unreconciled orphaned artifacts.
Why it was not solved earlier.
The drift built up gradually with the success of the platform: nobody is lying, everyone is right within their own scope. The complexity only became impossible to ignore once a critical mass of artifacts and providers was reached.

THE STORY

In 2016, BNP Paribas CIB launched an IT services marketplace. The idea was simple and the ambition modest: give internal teams a structured catalog of cloud resources, a single entry point to consume services without manual tickets and endless delays.

The bet paid off. Far too well.

Within a few months, its success outgrew the boundaries of the initial project. The scope extended to every business line, every internal service, every entity of the group. Thousands of employees consumed its services from Paris, New York and Singapore. Millions of artifacts were provisioned, modified, deprecated and recorded in 15 separate reference data repositories which, without coordinated governance, began to diverge silently.

That is the price of success: the faster a platform is adopted, the faster its data quality debt piles up. Each new participating provider brings its own naming conventions, its own life cycles, its own definitions of shared entities. Nobody is lying. Everyone is right within their own scope. And yet the 15 repositories no longer tell the same story.

Nobori Partners works at two distinct levels. First within the leadership of the team in charge of defining, building and running the marketplace products, at the heart of product and technical decisions. Then, when the scale of the data drift becomes impossible to ignore, as lead of the audit and the remediation plan.

The audit starts with archaeology. The goal is not to list anomalies; any ETL tool can do that. The goal is to understand why the system structurally produces them: map the interactions between providers through meta-orchestration, reconstruct the lineage of every artifact, and identify the friction points where repositories fall out of sync. The modeling reveals an architecture of complexity: cascading dependencies, life cycles that do not talk to each other, golden records that exist nowhere.

Then comes remediation. For every critical entity, a golden record is defined: a single reference version toward which all repositories converge. A unified data lake absorbs the multi-source complexity on S3 and Spark. NiFi and Airflow pipelines automate reconciliation. But the most tangible gain comes from the controlled removal of obsolete artifacts: thanks to a multi-step decommissioning process (identification, qualification, business validation, deletion), several thousand virtual machines are removed safely. Without this rigorous process, nobody dared to touch these artifacts for fear of breaking something.

But remediation is only a temporary victory if nobody watches what comes next. The last phase industrializes observability: QlikSense dashboards cover all 15 repositories, every quality indicator is visible the next day, and every synchronization anomaly is detected before it affects users in Paris, New York or Singapore.

The result: several thousand virtual machines removed through a controlled process, €2.5M in costs cut, data governance that holds over time, and thousands of people on 3 continents finally working from the same truth.

OUR APPROACH

4 steps to get there

1

Member of the provider board: CIB Marketplace

Part of the provider board from the design stage, Nobori defines the services to implement, takes part in the specification workshops and keeps the product vision consistent with technical reality. Every service designed here becomes a building block of a platform used directly by 150 people, and by thousands of employees through its services, on 3 continents: every architecture decision has a global reach.

ReactNodeJSPythonQlikSenseElastic
2

Full audit: mapping the chaos

Faced with 15 repositories silently drifting apart, Nobori runs an exhaustive audit: service modeling, identification of multi-provider interactions through meta-orchestration, reconstruction of the lineage of every artifact. The point is not to find anomalies but to understand why the system structurally produces them.

S3NiFiAirflow
3

Remediation plan: restoring a single source of truth

With the map complete, it is time for surgery: a golden record for every critical entity, a unified data lake to absorb multi-source complexity, automated remediation pipelines with NiFi and Airflow. The chaos of growth gives way to reference data: a single, reliable version, synchronized across 3 continents.

SparkS3Elastic
4

Industrialized observability: seeing before it breaks

Remediation would be pointless without the eyes to detect the next drift. Nobori deploys QlikSense observability dashboards covering all 15 repositories: every quality anomaly is visible the next day, and every synchronization indicator flags drifts before they affect users in Paris, New York or Singapore.

QlikSenseElastic

THE HARDEST STEP

Reconciling 15 repositories without interrupting a platform used on 3 continents

The audit had to do more than spot isolated anomalies: it had to understand why the system structurally produced them, by mapping the interactions between providers through meta-orchestration and reconstructing the lineage of every artifact.

What we did

A golden record defined for every critical entity, a unified data lake on S3 and Spark, NiFi and Airflow pipelines automating reconciliation. Industrialized observability deployed across all 15 repositories in real time.

What could have failed

Remediation without post-deployment observability would only have been a temporary victory: the next drift would have stayed invisible until it hit users.

RESULTS

The measurable impact

€2.5Msaved
15reference data repositories synchronized
3continents covered

15 repositories reconciled. Several thousand virtual machines removed through a controlled, multi-step decommissioning process. €2.5M saved. Next-day observability industrialized across all repositories.

Book a discovery call