Showing posts with label documentation. Show all posts
Showing posts with label documentation. Show all posts

Thursday, 16 January 2014

PRA - Q&A from December's Industry Briefing

Following on from the PRA's Industry Briefing on Solvency II prior to Christmas, they have released a set of Questions and Answers, which appear to have prompted by questions asked on the day as opposed to being more generic. A useful document to push around your programmes in the UK in particular, even if you are not part of ICAS+/IMAP.

I was particularly interested to see if they had rowed back on any topics where they have previously expressed an opinion, as well as any new insights which aren't necessarily made public as a matter of course. The Q&A is broken out into topics, so I have grouped my thoughts accordingly.

Proportionality
  • For ICAS+, the PRA are "...focusing in on those areas which move the dial the most", referring specifically to the ICA calculations.
  • They will therefore apply "a relatively higher view" in some areas than others (later referred to in terms of their intensity of focus).
  • They use their IMAP approach as an example of this, where they have grouped the 300+ requirements into 15 categories.
  • My common-sense read of this is, to be proportionate in the above context, the first 7 consecutive categories on the IMAP template would receive less time and attention than the following 8, all of which have the potential to numerically "move the dial".
  • They are already looking prospectively at firm's risk profiles during planning sessions, in advance of ORSA, so that they work and plan proportionally, but with the future in mind.
  • They suggest that firms provide their own opinions on materiality if they wish for the favourable application of the proportionality principle (though they don't guarantee it!).
Documentation-specific proportionality
  • Confirm that "...there is definitely a need for an improvement in the quality of documentation".
  • Seem to specifically align the calibration requirements of Solvency II with the need for additional documentation, therefore a good area to be elaborate in your work.
  • On expert judgement, they suggest that documenting why a judgement was made, and what were the alternatives will help firms currently falling short.
  • "...no aspiration" to revisit documentation review work already conducted and concluded.
PRA's Supervisory Statement
  • They confirm that letters confirming whether a firm is covered by the reporting guidelines will be sent this month. They suggest categories 1-3 (p20) will be the bulk of participants
  • There are national-specific reporting templates to come, currently under consideration. While they are not certain on submission format for those, they reiterate that xBRL is required for QRT submission.
  • QRTs can be submitted incomplete, but they reserve the right to intervene if you take too many liberties!
  • Acknowledge that, due to most firms' ORSA Processes operating around year-end balance sheets, that they expect to receive a flood of ORSA Supervisory Reports, and that this will delay feedback (presumably worse in 2015 than this year?).
  • A question regarding 'who is the ORSA for' was answered rather dismissively. However, bearing in mind the content of their "good and bad documentation" letter (which constantly refers to "the reader", which for me meant "the PRA"), it felt like a reasonable question. Clearly if the PRA do not like your style, it will add to your review time.
  • They seem to indicate that the amount of time one's Board should spend on reviewing/using their ORSA is not subject to any periodic expectations. That means if you are planning for annual intensive interaction, or something more regular and fluid, you should get a fair hearing from the PRA.
Standard Formula
  • Without much subtlety, they seem to be encouraging firms to look at the appropriateness of Standard Formula asap, encouraging further by stressing "...that internal models do not need to be overly complex". This feels like early positioning for their planned SF work with the industry, where no doubt they will find a few firms ripe for USPs/PIMs during the next 18 months. 
Early Warning Indicators (EWIs)
  • Following on from a post in October, they are evidently still stuggling to calibrate them!
  • They confirm that the purpose of automatic capital add-ons (in the event of a future EWI breach) is to freeze the modelled capital figure to prevent distribution
Trilogue
  • Question 29 is a good example of the PRA showing where their hands are now tied, and where EIOPA will be the provider of guidance.
  • Interesting confirmation that the Commission has apparently asked that as little as possible of the Draft Implementing Measures be changed. Those of us working on non-mathematical areas can perhaps take some comfort from that!



Wednesday, 18 December 2013

PRA on "good" and "bad" documentation for IMAP - restart or refresh?

As an welcome aside from the PRA's activity day on the 12th, they also delivered on a promise to provide examples of what constitutes "good" and "bad" documentation in the context of the internal model approval process (IMAP). Bearing in mind it has been quite some time since the PRA publicly pronounced on the matter - indeed, they were called something else the last time they did - the industry welcomed this in like a lottery-winning prodigal son.

Bad documentation
- reform or execute?
There have certainly been enough apocryphal tales spewed out by the industry over the last couple of years to suggest that the production of documentation to support participation in IMAP had transformed from a small cottage industry into something of a palatial Georgian Mansion house with a granny annex.

Whether or not this kind of advice is therefore timely enough to save the Solvency II Programmes of the UK from using documentation in their revitalised IMAP preparations that is neither good for man nor beast is another thing, bearing in mind there is three years worth of accumulated flotsam currently kicking around the servers of UK insurers which, given this message, will need to be revisited as a matter of urgency.

Regardless, as the UK still appear to hold the whip hand in EIOPA's model sub-committee, the PRA's views on model documentation are relevant to readers across the continent, so the document is well worth a read for anyone in pre-application.

I took the following from it;
  • They have 3 principles of "good documentation" - accessibility, evidence and quality control
  • "It is helpful to have a clear separation of policy, methodology and results"
  • The document refers throughout to giving consideration to "the reader". Feels a little disingenuous if they mean "the PRA", and after reading their document a couple of times, I can't imagine who else they have in mind.
  • Following on from that point, a reference to a bad example suggests that "...the author is not thinking carefully about the audience" - it is equally fair to suggest that the author may be assuming a level of technical/commercial knowledge at the PRA end which is lacking?
  • The PRA are evidently not happy to have to "seek clarification" on matters, which suggests the time allocated to assessments is tightly planned, or indeed the level of technical knowledge held by the assessors is limited.
  • Interested to know if these principles hold firm for Standard Formula firms if viewed conversely e.g. does paperwork for the justification to not use an internal model need to be of a similar standard?
  • The reiteration that the PRA "...will rely, in large part, on the submitted documents" when assessing the model - just in case your friendly executive committee reckon they can talk their way in!
  • A lofty aim to improve "accessibility" of documentation, by having levels covering; executive summaries; model reviewer/validator level info; and model user/operator level technical documentation. The PRA only want the first two levels as a matter of course, which would suggest that procedures and technical documentation should be used as supporting evidence only.
  • Tabling up references to the Directive and Implementing Measures within documents is viewed favourably.
  • Their "useful rule of thumb" feels instinctively unwieldy - they suggest better documents contain one-third 'what has been done' with the rest covering 'why and how'. That said, expert judgements are clearly not being evidenced anywhere near the level desired.
  • A convoluted and potentially frightening reference to "self-validation" testing, which the PRA view favourably, but which seems to point towards a preference to see suites of documentary evidence for each assumption applied in the modelling process. 
  • To conclude, readers are redirected to Julian Adams's letters from  mid- 2012 (here and here) - important to note that this guidance remains relevant, regardless of the passing of time.
I suspect that most model applicants will find they have re-work to do off the back of this, both with the pen and with the sickle. Expert judgement and assumptions documentation remain the unquenchable thirst though, so one's best endeavours would be well spent in that field in early 2014.