Business Overview:
In accordance with Section 165 of the Dodd-Frank Act (DFA), BNP Paribas has established an Intermediate Holding Company (IHC) over its U.S. subsidiaries. Furthermore, BNP Paribas has established a Combined U.S. Operations (CUSO) and IHC governance framework to support capital and liquidity risk management, regulatory reporting, and compliance risk management.
The Inspection Générale North America (IGNA) Hub is part of BNP Paribas’ global Internal Audit group (Inspection Générale, or “IG”). It is staffed by highly qualified individuals who conduct risk-based reviews to provide reasonable assurance to senior management regarding the adequacy of internal controls and to recommend improvements in controls and efficiency.
Within IGNA, a team dedicated to the audit of Enterprise Risk Management covers several business lines and corporate functions including Model and Artificial Intelligence Risk Management.
Candidate Success Factors:
Candidates are measured on the following four performance drivers, which will dictate how individual impact is considered on the Americas platform:
- Results and Impact
- Able to influence peers and team.
- Demonstrates good judgement when making decisions of high complexity and impact.
- Exercise appropriate autonomy in the execution and delivery of work.
- Responsible for driving outcomes, which have meaningful effect on team or department.
- Leadership and Collaboration:
- Creates trust with colleagues.
- Acts in leadership capacity for projects, processes, or programs.
- Client, Customer and Stakeholder Focus:
- Able to build relationships with a mix of colleagues and clients.
- Interacts regularly with management and department leaders.
- Demonstrates the ability to influence stakeholders at the team level.
- Compliance Culture and Conduct:
- Takes full responsibility for personal actions and demonstrates courage in facing problems and conflicts.
- Perceived as a person of high moral character; upholds corporate values and displays high ethical standards.
Responsibilities:
The Artificial Intelligence & Model Risk Auditor will play a key role in supporting the internal audit team in independently assessing the effectiveness of governance and risk management frameworks.
A strong background in frameworks for auditing models is a key requirement for this position.
Specific Artificial Intelligence and Model Risk Audit Responsibilities include:
- Apply frameworks for auditing models, including criteria such as robustness, fairness, interpretability, alignment, compliance, and human-in-the-loop assessments.
- Conduct audits across the model lifecycle, from training through deployment and monitoring, to assess compliance with quality, performance, fairness, and risk management standards.
- Identify model vulnerabilities, including bias, fairness violations, harmful hallucinations, and security risks, and recommend remediation strategies.
- Assess model performance metrics, including accuracy, precision, recall, F1 score, calibration, robustness, and fairness metrics; measure hallucination rates in LLMs; quantify bias and fairness; evaluate confidence scores; and perform stability analyses.
Specific Audit Responsibilities include:
- Conduct multiple complex and concurrent audit assignments, including related scoping, planning, evaluation, and reporting.
- Write audit reports containing value-added recommendations.
- Understand and assess the risks applicable to the areas of audit responsibility through continuous monitoring activities.
- Manage time and priorities while conducting audits.
- Review and prepare risk assessments for audit units.
- Develop and maintain relationships with heads and managers of business lines and functions as part of continuous risk monitoring activities.
- Validate the adequacy and appropriateness of remediation or resolution plans addressing regulatory and internal audit recommendations.
- Investigate serious incidents or cases of fraud, when required.
- Deliver clear presentations to senior management and IG management.
- Keep abreast of developments in auditing standards and key regulations governing compliance and operational risk management.
- Adopt and promote strong ethical values.
- Participate in various committees, as assigned, to report on and provide information about current and emerging business issues to senior management.
Minimum Required Qualifications:
- Bachelor’s or master’s degree in Mathematics, Statistics, Computer Science, Financial Engineering, or another related quantitative field.
- At least three years of professional experience in applied data science, machine learning engineering, or AI research, specifically involving LLMs and traditional machine learning models.
- Programming experience in statistical or mathematical languages such as Python or R, as well as hands-on experience with version control platforms such as GitHub.
- Experience with machine learning and NLP frameworks such as TensorFlow, PyTorch, and scikit-learn, and with relevant libraries such as pandas, Polars, and NumPy.
- Strong communication and synthesis skills, critical-thinking capabilities, and a passion for learning.
- Proficiency in English is required.
Preferred Qualifications:
- Professional certification, such as the CIA designation.
- Good knowledge of key U.S. and Canadian banking regulations affecting the areas in scope.
- Ability to analyze model design, training methods, and data pipelines.
FINRA Registrations Required:
CFTC Swap Dealer Associated Person (if yes, NFA Swaps Proficiency Program is required):
SEC Security-Based Swap Dealer Associated Person:
While the description above describes our ideal candidate, we encourage applicants to apply even if they do not fully meet the complete list of qualifications noted.
The expected starting salary range for this position is between $150,000 to $200,000 annually. The actual salary may vary based upon several factors including, but not limited to, relevant skills/experience, time in role, base salary of internal peers, prior performance, business line, and geographic/office location.
In addition, our comprehensive benefits package aims to support our employees in various aspects of their lives. From healthcare and wellness programs to retirement plans and childcare services, we prioritize the well-being and growth of our employees. Our benefits include medical, dental and vision coverage, a 401(k) Savings Plan, backup childcare, life, accident and disability insurance, mental health support and paid time off. Additional details about our benefits offerings, inclusive of eligibility for a discretionary bonus, will be provided during the hiring process.
About BNP Paribas:
BNP Paribas is a leading bank in Europe with an international reach across the US, EMEA and APAC. It has a presence in 65 countries, with nearly 190,000 employees. The bank employs over 3,500 people in offices in the US across 10 states including New York, Jersey City, Chesterbrook, PA, San Francisco, Boston, Chicago, Denver, Miami, and Washington, DC. BNP Paribas has built a strong and diversified presence to support its client base. We continue to grow and strengthen our commitment to the US market through our Corporate & Institutional Banking activities. We are one of a few non-US banks to offer a full value chain for our clients, from trading to financing, and clearing and custody in the US with the international footprint and capacity to deliver both globally and locally. Leveraging the strength of our European roots, our network can support clients in virtually every region of the world, enabling more connectivity and efficiency wherever our clients conduct business. We take pride in our expertise and our ability to adapt while constantly looking ahead to create a more sustainable world.
As an international company with a global footprint, the unique cultures and viewpoints of our team members are an integral part of the fabric of BNP Paribas. We are a company with a purpose - to be a responsible and sustainable global leader. We aim to create an environment where our employees feel empowered to drive change, make an impact and be true to themselves. We employ talented individuals from a wide variety of backgrounds, locally and globally, and are inspired by our employees who help us in cultivating a diverse, equitable and inclusive workplace through initiatives such as our Diversity, Equity & Inclusion (DEI) Leadership Forum and Employee Resource Group (ERG) communities. We strive to be a workplace where all team members can grow and thrive and offer robust training, development, and mentoring opportunities to make that vision a reality. Our leaders are deeply committed to DEI and highly accessible to our employees, consistently soliciting feedback on how we can continue to support our employees to reach their highest potential.
BNP Paribas. The Bank for a Changing World - https://usa.bnpparibas/en/homepage/join-us/our-opportunities/
