Chapter 15: Quantifying uncertainty in reserves Flashcards
We can consider the run-off of claims reserves to be a random process, with many random factors influencing the final outcome. These uncertain factors include:
- the occurence and severity of claims
- the notification delays on individual claims
- legal changes that affect the size of awards
- legal changes that affect the “heads of damage” changes in the litigiousness of society
- levels of claims inflation
- court rulings on liability or quantum of individual claims not foreseen by claims handlers and/or not in the historical data
- changes in the mix of claim types
- changes in claims handling
The projection of the run off of claims often introduces futher uncertainties, including:
- historic data only provides a limited sample
- quality of data may have varied over time
- there are many ways of deriving an estimate of the claims reserve and many judgemets required in each method
Terms used to identify sources of uncertainty or error
- process uncertainty
- parameter uncertainty
- model error
- systemic error
Process uncertainty
The uncertainty in what the future outcome will be, arising from the inherent variability of the data being analysed. This is the randomness of the underlying process.
Parameter uncertainty
The uncertainty in selecting the parameters within the reserving process and hence the results. Arises, for example, from the uncertainty around what the past data is telling us about the future.
Model error
The error/uncertainty arising from the fact that we might select an inappropriate model to derive our reserve estimates, or the model used may not be the only possible model
Systemic error
The uncertainty arising from unforeseen trends or shifts away from the current claims environment,
Types of ranges that may be used
- range of best estimates
- range of possible outcomes
- range of reasonable/probable/plausible outcomes
Range of possible outcomes
This represents the actuary’s estimate of the complete range of outcomes for future claims. It would be considerably wider than the range of best estimates
Range of reasonable/probable/plausible outcomes
Typically wider than the range of best estimates, but narrower than the range of possible outcomes, because it’ll allow for outcomes that cannot be reasonably regarded as an estimate of the mean outcome, but can still be regarded as a plausible outcome.
Advantages of using alternative sets of assumptions to quantify uncertainty in reserves
- it is simple to perform on deterministic or stochastic models
- we can use judgement when we select possible parameters. We can therefore allow for atypical volatlity in the historical data.
Disadvantages of using alternative sets of assumptions to quantify uncertainty in reserves
- we assign no explicit probability to each set of parameters. It’s not possible to estimate the distribution of future outcomes unless we assign a probability to each set of assumptions
- we ignore model uncertainty using this method
- we don’t allow for process uncertainty if use alternative sets of assumptions for a deterministic model. There is no reason why we cannot use alternative sets of assumptions for a stochastic model
Scenario analysis
We examine the likely impact of catastrophic events on a firm’s outstanding liabilities.
Ways of deriving a scenario for scenario analysis
- basing it on a historical event
- thinking up a hypothetical event using our judgement
- from the results of a stochastic model
Scenario analysis:
Typical scenarios affecting outstanding liabilities
- claims outstanding from a single catastrophe
- claims outstanding on major individual contracts
- latent claims
- reinsurance bad debt
- interest rate changes (if discounting reserves)
- inflation levels affecting the ultimate size of claims paid
- expense levels
- exchange rate movements if claims are paid in a foreign currency
Advantages of scenario testing
- advantage over stochastic modelling by allowing a more detailed analysis of the tail end of the reserve
- in performing a scenario test, we pay particular attention to the likely coincidence of these adverse factors
- a scenario analysis is more focused, whereas a stochastic approach provides a full analysis - time consuming and expensive
- because it is aimed at a specific question, we can construct a scenario test and produce reliable results more quickly than for a stochastic model
- easier to communicate the results of a scenario test than the results of a stochastic model, as they are more transparent
- model uncertainty is much less of a problem when we construct scenario tests because we consider the driving factors explicitly. Stochastic models may fail to capture some features of the real life process, especially under extreme circumstances
Disadvantages of scenario testing
- there is no specific probability associated with the outcomes and so it’s not possible to construct a distribution of outcomes (might be better than spurious accuracy of a stochastic model)
- scenarios only give information on the extremes of the distribution of the eventual outcomes, while the actuary may want to disclose information on the overall distributon to stakeholders too
- method is more subjective than stochastic models and alternative sets of assumptions, since the actuary makes the decision on which extreme scenarios are to be investigated
Relative merits of stochastic and deterministic approaches when quantifying the uncertainty in reserves
- deterministic approaches only consider limited number of factors and one result from each, while a stochastic model generates a number of potential scenarios that may not be thought of under a deterministic approach
- failure is often due to the interaction of many differing factors which could not be modelled deterministically. The stochastic model can allow for the interdependency of these key factors. Deterministic scenarios can be chosen in such a way as to estimate the interdependencies
- analysis of the impact of atypical scenarios aids understanding of variation around expected outcomes, and assigns a distinct value to them. This can be done to scenarios generated by a stochastic model or scenarios generated for a deterministic model
Stochastic claims reserving can be used to:
- assess reserve adequacy
- compare different estimates and datasets
- monitor performance
- allocate capital
- provide information to investors
- facilitate discussions with regulators
Reserve risk
The risk in respect of financial losses that could arise is the actual claim payments from expired business turn out to be higher than reserved for.
Main benefits of using a stochastic approach for reserving
- we can estimate the reliability of the fitted model and likely magnitude of random variation
- we may apply statistical tests to the modelling process to verify any assumptions and gain understanding of the variability of the claims process
- we can develop models in which the influence of each data point in determining the fitted model depends on the amount of random variation within that datapoint
Drawbacks of using a stochastic approach for reserving
- it takes more time
- it requires a high level of skill and training
- the methods are more complicated, so the risk of making mistakes is greater and they are harder to explain to a non-technical audience
- considerable element of judgeent is needed in the choice of model and in selecting the prior distribution with Bayesian methods
- using more sophisticated methods may lead to spurious accuracy and false confidence in the results
Components of model error
- specification error
- selection (or “systemic”) error
- estimation/parameter error
- process error
Specification error
This is the error arising from the specification of the model
Selection (or “systemic”) error
This arises from incorrect selection of the underlying data used. Trends may cause systematic changes to experience making the chosen data irrelevant.
