Manager, Model Quality (Business Acceptance Testing), Retail and Small Business (Contract)

December 27 2024
Industries Bank, Insurance, Financial services
Categories Purchasing, Procurement, Contracts,
Toronto, ON • Full time

Requisition ID: 212973

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

This is a temporary full-time opportunity and will run until October 30, 2026.

The world is changing faster than ever and so are we!

"Big data", "AI" and "machine learning" are not just buzzwords; they are part of our daily life. We have decades of data powering hundreds of models deployed across a multitude of systems that are crying out for smart talented team players who are results-oriented, have a broad understanding of best-in-class processes and relish the opportunity to help us turn our vision into reality. Are you ready to join the Winning Team not only building but actively managing the high-performing prediction and forecasting models behind automated risk-management decisions and forecasts that impact millions of customers and keep hundreds of $billions safe every single day?

Model Quality is all about ensuring that everything we build, we build right the first time, and we build them to last. The right candidate for this role is NOT someone who wants to design and build a handful of models each year but rather, is someone willing to take on the challenge of understanding how hundreds of them (spanning a wide range of problem types, employing a myriad of methodologies) work and can, commensurately, design and execute testing plans, and build capabilities to stress, test, and validate those models during pre and post implementation, and ongoing production runs.

This role will be a key member of Scotiabank's Retail & Small Business Model Operations team responsible for ensuring that every part of the model lifecycle from development to implementation, deployment to management, and tracking to governance unfolds as effectively & efficiently as possible. In Model Operations, we are passionate about arming our stakeholders with the best data & tools possible so that they can build and run the best models possible. We obsess over getting things done quickly and done right, the first time. We leverage a combination of business / technical consulting, collaborative development and verification / testing in our approaches.

We get excited by automation. We love working with people; both internally with our peers (across business strategy, risk & technology) and externally with vendors alike. We make modelling easier and models easier to use.

Getting models to market quickly is important but getting them "right" is even more so. That is where you come in.

What Are We Looking For?

We are seeking someone who embraces the idea of being:

  • A key primary contributor (i.e., a thought leader and a doer) who ensures that all
    advanced risk prediction and forecasting models, models that need to be not only accurate and precise, but highly stable, explainable, compliant, secure, and useful are implemented and monitored/reported properly

  • A subject matter expert, sharing best-in-class testing and acceptance practices to the department to be leveraged across all programs

  • A collaborative team player and owner who can prioritize projects and their own time to deliver the optimal balance of high value long-run results while remaining responsive to urgent and ever-shifting stakeholder needs

The ideal candidate for this role will be a consummate team player who is equally comfortable wearing the following hats:

  • Manager of Quality Assurance / Control / Testing

  • Data Engineer / Testing Automation Lead

  • Senior Data Analyst

Make An Impact

In this role, you will lead the testing of data changes, models, and crucial reporting impacting not just our partners but the bank's quarterly financial filings both with investors and with the regulator.

You will collaborate on a regular basis with a wide range of stakeholders and internal partners including Model Owners (model developers), Technology & Data, and Project Teams.

Is This Role Right for You?

  • You believe, first and foremost, in always doing the right thing and doing things the right way

  • You have demonstrated aptitude to design scenario-specific Test Approaches, Test Strategies & Plans, align test cases to requirements and user stories and select the appropriate test tools

  • You understand data engineering and modeling concepts to strategize and execute End to End testing cycles (Including data extraction, transformations and conversion)

  • You can evaluate test results, derive model and business insights, synthesize results and communicate high-quality recommendations effectively, both verbally, and in writing

  • You enable performance measurement by using standard metrics and drive continuous improvements

  • You ensure ongoing compliance with quality and industry regulatory requirements

  • Prepare quality documentation and reports by collecting, analyzing, and summarizing information and trends including failed processes, stability studies, corrective actions, and re-validations

  • You are willing and able to suggest and make framework enhancements to accommodate scripting needs for automation

  • You are curious, pragmatic, and a critical thinker

  • You have strong interpersonal skills and are able to interface and effectively influence at all organizational levels

  • You are professional, motivated AND FUN. We mean it.

What Do You Need to Succeed?

  • Bachelor's degree in engineering, Computer Science, Business Administration or an equivalent field

  • A demonstrated history of analytic problem solving and sound judgment

  • Experience as an analyst or data scientist with a track record of accomplishments working on cross-functional teams

  • Experience in, and strong understanding of testing standards and methodology, in QAT / UAT / BAT environments

  • Understands and utilizes both quality assurance and quality control best practices and how to apply them to models, data and technology from both a static and dynamic perspective

  • Highly proficient in 1 or more analytical programming languages (Python, R, SAS, etc.), SQL (Teradata, Oracle, DB2, SQL Server) and multiple environments (Unix & Windows)

  • Strong fundamental understanding of mathematical models, forecasting and statistics

  • Knowledge about credit risk models / scorecards

  • Microsoft Office (Word, Excel, etc.) power user with demonstrated experience writing professional acceptance reports, memos, and presentations

  • Familiar with both traditional SDLC and agile development processes & tools (Jira, Confluence)

  • Working Knowledge of Test Management Tools (Micro Focus ALM, Zephyr, Test Rail)

  • Experience with continuous Integration tools - Jenkins, Bit bucket, GitHub

What's in It for You?

  • We have an inclusive and collaborative work environment that values curiosity & ownership, encourages pragmatic creativity (i.e. true innovation), and celebrates success!

  • You'll get to work with and learn from an incredibly friendly and diverse group of accomplished leaders

  • Access to thousands of online and in person courses so you can brush up on skills, or learn new ones

  • Multiple career paths and innumerable progression opportunities. We hire you for your talent and not just for the job. We want to see you succeed not just in your role but in your career as a whole

  • A competitive rewards package that includes a base salary, a performance bonus, company matching programs on pension and profit sharing, paid vacation, personal & sick days, medical, vision and dental benefits that start from day one and much more!

Location(s): Canada : Ontario : Toronto

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

Apply now!

Similar offers

Searching...
No similar offer found.
An error has occured, try again later.

Jobs.ca network