SQA Consulting provides a Screening Assurance service based around our product The Screening Assessment Centre. The Screening Assessment Centre can create test files covering multiple scenarios for assessing the fuzzy matching capability for both personal and entity type names. Over 60 scenarios are considered by the system and the results are continuously benchmarked against peer FIs.
A single test file can be screened at multiple different thresholds and the results analysed and compared against each other as well as against the SQA screening benchmark.
The client was provided with a comprehensive report indicating how well the system performed at the various thresholds for both the false-positive rates and the fuzzy matching capability. The strengths and weaknesses in the fuzzy matching capability at the various thresholds were benchmarked across the different thresholds and also compared to other peer FIs included on the SQA benchmark. The Client was able to make an informed decision as to which threshold would be appropriate for their Sanctions Screening. The Graph below compares rates of Effectiveness and Efficiency for different Thresholds.
The green line and dots represent different screening thresholds.
Sample Conclusions and Graphs included in the report: In this example, the threshold of 75 proves effective at a rate of just under 70% but the associated level of false positives is high at 6.5%. The threshold of 91 realises a false positive ratio of approx. 2%. Whereas the threshold of 90 realises a false positive ratio of 4%, doubling the rate of false positives for a low improvement in effectiveness as the effective rate moves from 54% to just 56%. This example demonstrates the impact a minor change to the threshold can have.
A document such as this is exactly what a regulator is looking for. It demonstrates that there is a clear understanding of the adopted screening approach and that appropriate assurance steps have been taking as part of the implementation.
In addition, identifying the anticipated levels of false positives relative to the size of the customer base to be screened enabled the Client to set up adequate resourcing levels to process the alerts within their defined SLAs.
