Lloyds of London on Validation - testing and reporting enhancement ideas

Lloyds of London delivered a presentation around model validation last week to its 80-odd syndicates which anyone in the world of IMAP would benefit from picking through the bones of, bearing in mind the rather unique position of the Lloyds application (i.e. in the door of the PRA, and seemingly well received!).

They had noted in that presentation linked to above that they had found some weaknesses in 5 areas in particular, so this presentation is a deep-dive examining the strengths and weaknesses of validation - one may expect the other 4 'weak' areas flagged may receive similar treatment in coming weeks.

While their 2013 programme aims only to close the gap between full compliance with Solvency II tests and standards and today's position, it's worth flagging some fundamentals;

• Only half of syndicates felt to meet tests and standards in full - a third are 'pending' positive assessment, the rest have not passed.
• 'Fails' seem to be centred around following up on test failures and documenting findings in the summary report, rather than anything broader.

Around the production of Validation Reports, they noted negative findings around;

• Uncertainty about how to progress when something 'unacceptable' is found during validation testing
• Content of validation reports being statistic-heavy (i.e. indigestible to any non-quants who need to make decisions off the back of the findings)
• A lack of sophistication in the testing of material risks in some instances.

The last one is particularly interesting, as the central team at Lloyds has devised a schematic (slide 11) to show the kind of testing they expect to see on the more material risks (RST, P&L attribution) versus less material (going as far as qualitative tests).

It is also worth highlighting for any benchmarkers out there that Lloyds appear to advocate around 5 pages of Validation Report per risk factor, leaving their overall expectation of reports to be 30-40 pages, with 5-10 pages of appendices (p16). Bearing in mind these reports will I suspect be some of the first to go through the PRA's hands, the frame of reference may help encourage you to bulk up or slim down your own versions!

A large amount of this presentation (from p19 onwards) is devoted to fairly granular examples of how a validation test may be 'failed', and what action would be performed in order to gain a 'pass', so for those in the test design/conduct game, you may find something to support your approaches in that detail, regardless of the risks shown in the example (premium and reserve).

Elderfield at the European Insurance Forum - one for the road...

So the European Insurance Forum is in full swing over in Dublin, which from what I have seen to date in the tweetosphere (thanks DIMA and Mike!), sounds more like Alan Partridge's sales conference for Ireland plc.

That aside, Matthew Elderfield, the outgoing Head of Financial Regulation at the Central Bank of Ireland, gave a rousing speech touching on risk-based supervision and the 'prospects' for Solvency II. As a member of EIOPA's management board and head of the second largest internal model assessment body in the EU, his words are very much worth heeding.

Given that he has already addressed this forum a couple of years ago on such matters, as well as being relatively outspoken  recently on the quality of components parts of Irish risk management systems, one might expect a few home truths on his way out of the door to an equally precarious task as Head of Compliance at Lloyds Banking Group.

EIF 2013 - More to Ireland 'dan dis'?

The headline acts for me was his revelation that diversification in internal models remains a bugbear, to the extent that he supports the kind of 'floor' arrangement being given airtime at the PRA. Given he had already made his distaste at the extent of the diversification benefits being sought clear in a speech last year, it is not surprise to see it on his agenda, more that it implies that the expert judgements of those involved in the calculation process may be overridden (due to regulatory prudence?), regardless of how well they are documented or supported. 

In addition, his angle on bridging the LTG issue makes interesting reading for anyone who doesn't receive briefings on EIOPA's inner workings.

Noteworthy points (my emphasis if emboldened) therefore included;

On Solvency II

• Drawn out process has "naturally resulted in a combination of fatigue and exasperation", with the "...high costs of preparation compounding concerns"
• Regardless, "it is unacceptable that the common regulatory framework for insurance in Europe in the 21st century is not risk-based"
• "Urgently need" the framework to reflect asset risks, riskiness of different lines of business, encourage better governance and risk management, and provide better disclosure.
• "Solvency II does indeed have its imperfections", but "...the benefits of moving ahead with Solvency II outweigh the costs..."
• Notes his "long-standing concern" around over-optimism in the calibration of internal models
• "...complexity has clearly gone too far in some areas - and makes implementation very difficult for smaller companies"

On Omnibus II and EIOPA's LTGA

• Omnibus II delay "...is a course of considerable concern to regulators and industry alike", and the "...entire framework is essentially stuck on one issue" which "...will require a political compromise"
• Personally supports a more generous approach to matched premium adjustments on certain lines of business, provided they are (a) only applied to the back-book, (b) companies provide Pillar 3 disclosures both with and without those adjustments, and (c) supervisors can apply capital charges if they are not happy.
• "With European elections looming next year, it is important that this process concludes in the autumn at the latest"

EIOPA - filling gaps
since 2013

On EIOPA's Interim Guidelines

• As justification for supporting them, "Much of the Solvency II framework is already clear", and emphasises that "we will adopt a proportionate approach"
• EIOPA is "helping 'fill the gap' created by the hiatus in the political negotiation"
• "The EIOPA initiative should be strongly welcomed by regulators and industry alike"
• Hopes the system of governance and ORSA interim guidance provide "manageable and useful transitional steps towards full Solvency II adoption"
• For Pillar 3, expecting "best efforts" especially from High Impact insurers, with the use of statutory powers held in reserve "as a last resort.
• For IMAP, can neither sanction an "early conclusion" nor a "hard stop", so will ultimately elongate the administrative burden, hopefully leaving less to do towards the end.

On Diversification benefits

• "...in common with a number of other [unnamed] supervisors", CBoI is concerned to ensure "prudent recognition of diversification effects"
• "Fundamentally, what is needed is a broad agreement on the outer bounds of acceptable levels of diversification in the model approval process", citing one jurisdiction (UK?) looking at hard SCR floors based on proportion of MCR.
• "...the Central Bank's message to Irish firms is to take a conservative approach to the recognition of diversification..."
• Points to the failure to add formal constraints on diversification benefits in the Directive text
• "Supervisory quants are at risk of being outgunned by industry quants in the minutiae of a correlation debate"
• Also has a stab at "overly generous approval" in other member states in the context of regulatory arbitrage - is it that hard to say "no" just because the home regulator says "yes"?

Of less consequence for those outside of Ireland, he goes on to cover the CBoI's bespoke work around VA-specific risks (in light of prolonged low interest rate environment), the failure of Quinn Insurance, and the bedding in of their PRISM risk-based supervisory framework, the latter eliciting the comment that "we are still some way from fully embedding our new approach".

From this, one might reasonably think that, should Mr Elderfield's successor continue in the same vein, that the correlation matrices of Ireland's 30-something IMAP candidates are likely to get a severe working over in the next couple of years. Let's hope the industry gets their documentation in order!

FSA - Solvency II speeches this week from the great (and greater!)

A couple of topical speeches delivered this week by Canary Wharf's finest, both of which are relevant to the Solvency II world.

First, a speech at the 2012 Risk and Investment conference run through The Actuarial Profession and featuring some multidisciplinary heavy hitters from TV and print as well as some C-suite presence from the UK's largest multinationals. The FSA's Kathryn Morgan delivered a speech which covered Pillar 2 and 3 trends in particular, which is covered in this subscription only article at Risk.net. For those who don't have the budget for that, a pruned down version of that content is available here.

Ostensibly, the following points were made;

• Don't expect any more FSA guidance on conducting an ORSA - fair point at this juncture, if you don't know your onions by now, there's probably no hope for you!
• Approaching implementation consecutively in 3 pillars is a "worry" - I suspect that worry, misplaced or not, is applicable to most undertakings at this juncture
• "Risk management is the best mitigant of risk, not capital" - I would argue an effective Risk function rather than risk management per se is the best mitigant, but it is slightly more ethereal than a big bundle of cash!
• Perception that "...Risk and Capital are not talking to each other" - true out of necessity at this juncture perhaps (BAU for the balance sheet guys, model applicants or not, and the administrative burden of refreshing documentation suites has impeded comms for some time I would argue, but this will improve in the very near future).
• Number of references to Boards, centred around NEDs participating fully in decisions rather than counting the hours till their taxi arrives, as well as not relying on SMEs to make decisions for them (i.e. Actuarially-minded board members are not left to perform all balance sheet related challenge on their own!)
• With regards to the empire built on sand which is the legislative timeline, reiterates that while some key balance sheet-related issues are yet to flesh out, "...their is a lot of certainty in Pillar 2" - something I have banged on about since the draft Level 2 implementing measures were leaked in November.

While that speech has good insights for you Pillar 2 folk out there, a lecture from Julian Adams on "the impact of changing regulation on the insurance industry" is equally fascinating, if perhaps treading over some Solvency II ground already covered over the last couple of weeks - as a History graduate, I always like a cheeky overview, and the lecture covers legislative developments back to Victorian times.

That aside, a few Solvency II-relevant snippets were also included (or reiterated from prior speeches) such as;

• A definition of what "risk sensitive" regulation actually means (insurers' solvency positions matching their idiosyncratic risk profiles) - something as succinct as that is actually extremely useful for board training purposes at the very least, and I am glad he has communicated it in this manner.
• Also defines "proportionate" from the FSA's perspective on internal model approval - namely, if it is in the Directive or the Implementing measures, it is not negotiable.
• Notes that Solvency II is "influencing" the global regulatory framework - I would argue that strong-arming (in the case of first/second wave countries) and bickering (in the case of the States) is far from influencing, though with the IAIS Comframe draft now open for review, we may see something more resembling dialogue from our pals in Brussels
• Rather worrying comment that, in the context of reporting financial positions, that Solvency II reporting sits in the succession path of EEV and MCEV as "...if perhaps not the final, then the latest step" towards a more transparent and market consistent reporting regime. Anyone for SFCR 2.0?
• A rather ominous note that the standard formula calculation "...would certainly have a distorting effect when considering, say, the London Market subscription business or with-profits businesses" - I hope all you tiny mutuals have got your IMs, PIMs or USPs ready, as it sounds like the FSA may already think SF is not suitable for you!
• Acknowledges that Solvency II is about "maximum harmonisation", and therefore EIOPA will call more of the shots in future (just as soon as Omnibus II gets through...)
• Highlights that the academic modelling around (a lack of) correlation drove many of the banks models' into stupidity in 2006-2008 - an area I would expect fervent challenge around from both the regulator and indeed internal governance structures (and one which Matthew Elderfield at the Central Bank of Ireland has already picked up on as a main area of focus)

Useful stuff from both sources, so keep it up Wharfers!

PS I suspect I won't be posting tomorrow, so I will wish you shoh slaynt and a happy Tynwald Day one day early!

Lloyds of London on Validation - Workshop Output

For all of you working on one of the FSA's (and indeed I suspect other supervisors') pet peeves, Model Validation, the Lloyds guys published some slides from their recent workshop on the topic.

Anyone not in the IMAP space may still find their presentation of interest, particularly as they have already had to ask for 3 months leeway on their original application "landing window", perhaps hinting at the enormous complexity and expense of producing material to support a successful model application.

They start with a "Top 5" ways to improve existing validation practices, rather worryingly stressing coverage and ranking, which one would think would be par for the course rather than something which required additional emphasis. They go on to hint at, if not confirm;

• That both analysis of test results and subsequent escalation has been found to be lacking during their validation dry run
• That historical syndicate experience is "always necessary" in modelling, even if not sufficient on its won
• An over-reliance on sensitivity testing using pre-defined SCR ranges
• Their recommended materiality hierarchy of validation tests
• Their take on reserving risk (not my forte, but dig in if it's yours)
• Their take on correlations and the diversification matrix (interesting bit on diversification in the tail)
• That their model walkthrough exercises brought up material issues for "most" agents, and that clearly some syndicates have been asked to complete remedial action before the end of this month
• That they are waiting for L3 before reviewing their validation reporting formally.

Not sure whether this keeps the guys on track for their group application, but certainly not an unhealthy thing to be picking up such flaws at this stage - if it was that easy, everyone would be doing it!

Elderfield speech to Insurance Day summit in Bermuda - equivalence, model approval and "hub and spoke"

Very informative speech delivered this week by Mr Elderfield from the Central Bank of Ireland to the Insurance Day summit held in his previous stomping ground of Bermuda (certainly a more welcoming climate that last month's summit in not-so-sunny London!).

He mainly covers equivalence, internal model applications and, as one might expect from the Emerald Isle, the potential for Hub and Spoke operations and the potential capital benefits of this technique (which has a sniff of Group Support about it in all but name). I noted the following;

General

• Suggests Solvency II provides "...an incentive for investment in risk management, including the use of internal models" - I would substitute "incentive" for "compulsion"!
• Singles out "small firms" as those which will "certainly" struggle to assimilate and implement Solvency II in its current guise
• Notes that "...the current target is that member state governments will domestically implement [Solvency II] by 30th June 2013" - I have emphasised the "current target", as the very wording suggests that there is an implication it is not the "final target"!

Model applications

• "...it is important that approval process doesn't get bogged down in detail such as endless documentation reviews" - cue some raised handbags down at Canary Wharf I suspect!
• Highlights expert judgements around correlation and diversification (as he has done this time last year) as being much more significant around challenging the solvency requirements calculated by the models, in particular the "swing" these elements have on the final numbers. On that premise, he puts these "...at the forefront of the regulatory approval process", as well as expecting them to generate the most challenge in the boardroom.
• Elaborates on the extent of Board challenge by commenting that "...boards should be expected to challenge vigorously the amount of diversification benefit being claimed in internal models, even if they don't know the internal plumbing of copulas or correlation matrices". Very telling comment, and clearly one to heed, bearing in mind he is on EIOPA's management board.

Hub and Spoke

• Seeing "considerable interest" in using Ireland for the "hub" of the "hub and spoke" business model - one may have said this was for regulatory arbitrage purposes 5 years ago, but I'm guessing corporation tax, falling wages and underemployment may have kept it in play even after the recent beefing up of the CBoI
• Comments that "...it will be interesting to see whether [the hub and spoke] model will grow as Solvency II gets closer to implementation - implies that not only does he think the existing corporate structures are not settled yet, but that Ireland is actively open for business in this regard.

Equivalence

• Not sure if he was just being polite to his hosts, but he commented "...Bermuda is very well placed for [the equivalence] assessment process" - again worth heeding in the context of his position at EIOPA, as well as Bermuda coming off worst of the 3 countries which have been assessed in wave 1.
• Suggests there should be some sort of early adopter's premium for Bermuda which makes it worth being ahead of those countries who may come in in wave 2 (no mention of one of their competitors Guernsey in this context, who continue to bang the IAIS ICP drum while stating categorically that they will not seek equivalence).

Good intelligence all in all - PS must try and swing an invite to one of these things when they go tropical!