Model Validation Senior Manager

• The second line of defence Model Oversight team (that’s us!) provides support to our colleagues in Borrowing, Fincrime & Fraud, Finance and Operations to help Monzo grow safely. We’re looking for a Model Validation Senior Manager - Gen AI to lead the teams’ oversight of Generative AI models/use cases (primarily built across Monzo’s Operations squads) to provide assurance that the models/use cases we use are not only good for Monzo but what’s best for our customers
• Lead the collaboration with the first line of defence teams to strengthen policies, standards and procedures for Generative AI model, use case, system design and build, implementation, governance, monitoring and use. Helping to embed best practice of Generative AI across the business
• Own the setting and maintenance of Generative AI validation methods, evidence expectations and reusable technical assets with relevant 1LoD modelling teams, applicable across all model risk areas
• Convert modelling/validation experience into controlled playbooks, tests and working examples that can be applied to 2LoD Validation standards and processes for all Generative AI models, use cases, systems overseen by the 2LoD Model Oversight team
• Coach Generative AI validation methodologies, to 2LoD Model Oversight colleagues, whom already have transferable Machine Learning skills, to reduce reliance on any single specialist for the validation of Generative AI models, use cases, systems so it can be consistently applied across Financial, Credit and Fincrime/Fraud models
• Perform, and oversee, independent model validations of new Operational models (primarily Generative AI models, use cases, systems), and changes to existing, using proportionate modelling techniques depending on the level of complexity applied. This includes writing clear and impactful model validation reports and presenting the findings in relevant committees
• Build relationships with first line of defence modelling teams that develop Operational Models, and wider risk teams, to support the embedding of the model risk framework to help Monzo grow safely
• Review ongoing model performance monitoring to ensure Operational models are performing within risk thresholds and providing support to the relevant model development team when further action is required
• Monitoring and measuring the overall level of Operational model risk that Monzo operates, and driving action plans with first line teams and appropriate governance forums to mitigate residual model risk within desired risk appetite
• Support the effective operation of the Model Risk Oversight Committee as a regular attendee, contributing to the group discussion to improve model risk management
• Promote and help embed a strong risk culture, making risk meaningful and relevant to everyone at Monzo. You will share best practice that is easy for everyone to understand

Benefits

• Yearly Salary Review + Proactive pay increases to reflect growing responsibilities + Share options
• Flexible working hours
• Work From Home Opportunities + we’ll pay for any equipment you need to do your job
• 24 days holiday a year, plus bank holidays
• Employee Assistance Programme
• Paid sick leave for both physical & mental health + Health insurance via AXA or Vitality + Additional health insurance through Medicash
• Learning budget of £1,000 a year
• Aviva Pension Scheme + 4% Employer Contribution
• Paid maternity, paternity, adoption or shared parental leave (after 13 weeks of employment)
• 52 weeks of primary caregiver leave (6 months at 100% pay, 13 weeks at Statutory Maternity Pay, 13 weeks unpaid)
• 3 months of secondary caregiver leave at 100% pay
• Unum Life Insurance
• Access to fertility and family-forming health benefits via Fertifa
• Abellio Season Travel Tickets + Cycle-to-Work Scheme
• You are keen to grow your knowledge in both business and technology
• You are highly motivated and energised by the idea of bringing positive impact to our customers and Monzo
• You are a great communicator, able to articulate complex problems
• You are self-motivated and thrive in a fast-paced environment
• You have great attention to detail while keeping an eye on the big picture
• You can provide effective challenge whilst building strong, respectful relationships
• Coaching and standard setting
• Experience with design of Generative AI evaluation frameworks, architectures, methods, practical tooling and platform alignment
• Robust Data Science or Machine Learning background with strong Python capability
• Knowledge of Gemini implementations and change assessment
• Banking MRM and regulatory context
• Experience of managing a modelling project through its full lifecycle
• If possible, some understanding of some of the following: