Studying for SOA Exam C

Maximum Likelihood Estimators

uclatommy — Sat, 27 Feb 2010 20:27:41 +0000

With Maximum Likelihood Estimator (MLE) problems, a parametric distribution is named, one or more of it’s parameter values are unknown, a set of data from this distribution is given, and you’re asked to find the parameter values that maximize the probability of observing the data. You do this by brute force. For each data point, you express the probability of observing it, which is simply the density function of whatever named distribution was given in the problem. The probability of observing the whole set of data is simply the product of the probability of each data point. If there are lots of data points, you end up with a massive function.

For example, the density function for is given by:

in which is the unknown parameter. You are also given a set of observations and you must find the value of which maximizes the probability of seeing these particular values. The likelihood of seeing these values is given by :

To find which maximizes this function, you take the derivative of it, set it equal to 0, and solve for . If you’re looking a few steps ahead, you should realize that doing the maximization by brute force will be difficult. To get around this, we can log the likelihood function then find the maximum. This does not change the resulting value of . The log likelihood is then:

The derivative with respect to is

Equating to 0 and solving, we have

Filed under: Empirical Models Tagged: Data, Empirical, Estimator, Likelihood function, Log Likelihood function, Maximum Likelihood Estimator

Kaplan-Meier and Nelson-Aalen Estimators

uclatommy — Sun, 21 Sep 2008 03:10:07 +0000

When the empirical data is incomplete (truncated or censored), raw empirical estimators will not produce good results. In this scenario, there are two techniques available to determine the distribution function based on the data. The Kaplan-Meier product limit estimator can be used to generate a survival distribution function. The Nelson-Aalen estimator can be used to generate a cumulative hazard rate function. The Kaplan-Meier estimator is given by:

where is the risk set at time and is the number of observations from the random event whose distribution you are trying to estimate. For example, if the random event you are interested in is death, then could be the number of life insurance policy holders immediately prior to the first death, and would be the number of observed deaths at the time of the first death (you can have simultaneous deaths). The key to dealing with problems that use this estimator is to understand how changes with respect to censoring or truncation. If a person withdraws from the life insurance policy, this decreases but this is not a death, so it does not contribute to . If new members join at time , they are not part of the risk set until time .

If the data is censored past a certain point, you can assume an exponential distribution for the censored portion. Suppose observations past are censored. If you know the value of you can solve for using .

The Nelson-Aalen cumulative hazard rate estimator is given by:

You can use this to get a survival function:

Posted in Empirical Models Tagged: Censored, Cumulative Hazard Rate, Empirical Distribution, Estimator, Incomplete Data, Kaplan-Meier, Nelson-Aalen, Product Limit, Truncated

Statistics for Empirical Models

uclatommy — Sat, 20 Sep 2008 20:48:33 +0000

An empirical model makes an assumption about the type of distribution underlying a set of data. The data is then used to estimate the parameters in the assumed underlying distribution. For example, if it is assumed that the underlying distribution is a uniform distribution, the data may be used to estimate the maximum value that the random variable can have. If the assumed underlying distribution is Poisson, the data may be used to estimate the rate parameter . There are three measures of quality for these estimators– bias, consistency, and mean squared error.

Definitions:

Let be an estimator and be the true parameter being estimated. The bias is defined by: . An estimator is said to be unbiased if .
An estimator is said to be consistent if for any 0' title='\delta > 0' class='latex' />, , where is the estimator based on observations.
The Mean Squared Error is . A low mean squared error is desirable.

The following relationship is useful:

CONFIDENCE INTERVALS
To determine a construct a confidence interval for an estimator, you simply add and subtract to the estimate where is the appropriate z-value from the standard normal table and is the square root of the variance of the estimator. So a 95% confidence interval for an estimator would be

You can usually express the variance of the estimator in terms of the true parameter. In that case you can substitute the estimated variance with the true variance of the estimator based on your assumption of the underlying distribution.

When the variance of an estimator can be expressed in terms of the true parameter that you are trying to estimate, a more accurate confidence interval can be derived by

Solving for gives the interval.

STATISTICS OF ESTIMATORS
An important point to keep in mind is that the results you observe in the data is the outcome of a random variable. Since estimators are calculated based on these observations, they are a function of the results of a random variable. If you make some assumptions about the underlying distribution, you can calculate the statistics of an estimator, such as the variance of an estimator. For example, in a population of 100, you observe 5 claims. You assume the underlying distribution for the number of claims per person is poisson and you estimate its parameter to be . This means your equation for the estimator is:

where represents the true underlying distribution for each person. Thus the variance of your estimator is given by

Since you’ve assumed the underlying distribution to be poisson,

where is the variance of . This is how you can arrive at equations for the statistics of estimators based on an assumed underlying distribution. The key is to realize that there is a link between the estimator and the true underlying distribution.

Posted in Empirical Models Tagged: Bias, Confidence Interval, Consistent, Estimator, Mean Squared Error, Variance of Estimator

Ruin Theory

uclatommy — Sat, 13 Sep 2008 17:47:34 +0000

You walk into a casino with a certain amount of surplus money. Every hour you spend in the casino, there is a certain probability of winning or losing some given amount of money. A ruin theory question might ask, what is the probability that you go bankrupt in x number of hours. The bankruptcy state is an absorbing state, so once you enter into that state, the probability of leaving that state is 0. The solution to these types of problems usually require calculating an exhaustive list of probabilities for ruin by the convolution method. But first, familiarity with the notation should be developed.

Definitions:

— Starting with surplus , this is the probability of ruin as goes to infinity with defined on .
— Same as above except , positive integers.
— Probability of ruin from time 0 to time with .
— Same as above except .

The analogous survival probabilities follow the same conventions except they are denoted by .

The following relationships are useful:

Recursive Discrete Aggregate Loss

uclatommy — Sat, 13 Sep 2008 15:48:12 +0000

You have 2 six-sided dice. You roll one dice to determine the number of times you will roll the second dice. The sum of the results of each roll of the second dice is the amount of aggregate loss. Since the frequency and severity are discrete, for any aggregate loss amount, the number of combinations of rolls to produce such an amount is clearly countable and finite. For example, an aggregate loss amount of 3 can be arrived at by rolling a 1 on the first dice, then rolling a 3; or rolling a 2, then rolling the combinations (1,2),(2,1); or rolling a 3 and then rolling (1,1,1) on the second dice. The probability of experiencing an aggregate loss of 3 is:

This method of calculating the probability is called the convolution method. Now imagine the frequency and severity distributions are discrete but infinite. To calculate would require calculating the probability for many possible combinations. If the discrete functions are from the (a,b,0) class, there is a recursive formula that can calculate this. It is given by:

where is an integer, , , and . This is called the recursive method. To start the recursion, you need to find . You can then find any . If a problem asks for , this is equal to . You iterate through the recursion to find each then add them together.

Approximating Aggregate Losses

uclatommy — Mon, 01 Sep 2008 00:43:53 +0000

An aggregate loss is the sum of all losses in a certain period of time. There are an unknown number of losses that may occur and each loss is an unknown amount . is called the frequency random variable and is called the severity. This situation can be modeled using a compound distribution of and . The model is specified by:

where is the random variable for frequency and the ‘s are IID random variables for severity. This type of structure is called a collective risk model.

An alternative way to model aggregate loss is to model each risk using a different distribution appropriate to that risk. For example, in a portfolio of risks, one may be modeled using a pareto distribution and another may be modeled with an exponential distribution. The expected aggregate loss would be the sum of the individual expected losses. This is called an individual risk model and is given by:

where is the number of individual risks in the portfolio and the ‘s are random variables for the individual losses. The ‘s are NOT IID, and is known.

Both of these models are tested in the exam; however, the individual risk model is usually tested in combination with the collective risk model. An example of a problem structure that combines the two is given below.

Example 1: Your company sells car insurance policies. The in-force policies are categorized into high-risk and low-risk groups. In the high-risk group, the number of claims in a year is poisson with a mean of 30. The number of claims for the low-risk group is poisson with a mean of 10. The amount of each claim is pareto distributed with and .
Analysis: Being able to see the structure of the problem is a very important first step in being able to solve it. In this situation, you would model the aggregate loss as an individual risk model. There are 2 individual risks– high and low risk. For each group, you would model the aggregate loss using a collective risk model. For the high-risk, the frequency is poisson with mean 30 and the severity is pareto with and . For the low-risk group, the frequency is poisson with mean 10 and the severity is pareto with the same parameters.

For these problems, you will need to know how to:

Find the expected aggregate loss.
Find the variance of aggregate loss.
Approximate the probability that the aggregate loss will be above or below a certain amount using a normal distribution.
Example: what is the probability that aggregate losses are below $5,000?
Determine how many risks would need to be in a portfolio for the probability of aggregate loss to reach a given level of certainty for a given amount.
Example: how many policies should you underwrite so that the aggregate loss is less than the expected aggregate loss with a 95% degree of certainty?
Determine how long your risk exposure should be for the probability of aggregate loss to reach a given level of certainty for a given amount.

Problems that require you to determine probabilities for the aggregate loss will usually state that you should use a normal approximation. This will require the calculation of the expected aggregate loss and the variance of the aggregate loss.

MEMORIZE
Expected aggregate loss for a collective risk model is given by:

For the individual risk model, it is

Variances under the collective risk model are conditional variances.

When frequency and severity are independent, the following shortcut is valid and is called a compound variance:

Variance under the individual risk model is additive:

Example 2: Continuing from Example 1, calculate the mean and variance of the aggregate loss. Assume frequency and severity are independent.
Answer: This is done by

Calculating the expected aggregate loss and variance in the high-risk group.
Calculating the expected aggregate loss and variance in the low-risk group.
Adding the expected values from both groups to get the total expected aggregate loss.
Adding the variances from both groups to get the total variance.

I will use subscript and to denote high and low risk groups respectively.

Add expected values to get

Add variances to get

Once the mean and variance of the aggregate loss has been calculated, you can use them to approximate probabilities for aggregate losses using a normal distribution.

Example 3: Continuing from Example 2, use a normal approximation for aggregate loss to calculate the probability that losses exceed $12,000.
Answer: To solve this, you will need to calculate a value for the normal distribution using the expected value and variance found in Example 2.

12,000) &=& 1- \Pr(S< 12,000) \\ \\ &=& \displaystyle 1-\Phi\left(\frac{12,000 - 8,000}{\sqrt{3,200,000}}\right) \\ \\ &=& 1 - \Phi(2.24) \\ \\ &=& 0.0125 \end{array}' title='\begin{array}{rll} \Pr(S > 12,000) &=& 1- \Pr(S< 12,000) \\ \\ &=& \displaystyle 1-\Phi\left(\frac{12,000 - 8,000}{\sqrt{3,200,000}}\right) \\ \\ &=& 1 - \Phi(2.24) \\ \\ &=& 0.0125 \end{array}' class='latex' />

CONTINUITY CORRECTION
Suppose in the above examples the severity is discrete. For example, is poisson. Under this specification, we need to add 0.5 to 12,000 in the calculation for 12,000)' title='\Pr(S > 12,000)' class='latex' />. So we would instead calculate 12,000.5)' title='\Pr(S > 12,000.5)' class='latex' /> This is called a continuity correction and occurs when we have a discrete severity random variable. If we were interested in , we would subtract 0.5 instead. This has a greater effect when the domain of possible values is smaller.

Another type of problem I’ve encountered in the samples is constructed as follows:

Example 4: You drive a 1992 Honda Prelude Si piece-of-crap-mobile (no, that’s my old car and you are driving it because I sold it to you to buy my Mercedes). The failure rate per year is poisson with mean 2. The average cost of repair for each instance of breakdown is $500 with a standard deviation of $1000. How many years do you have to continue driving the car so that the probability of the total maintenance cost exceeding 120% of the expected total maintenance cost is less than 10%? (Assume the car is so crappy that it cannot deteriorate any further so the failure rates and average repair costs remain constant every year.)
Answer: For one year,

For years, we have

According to the problem, we are interested in such that 1,200n) = 0.1' title='\Pr(S > 1,200n) = 0.1' class='latex' />. Under normal approximation, this implies

1,200n) &=& 1-\Pr(S<1,200n) \\ \\ &=& \displaystyle 1- \Phi\left(\frac{1,200n - 1,000n}{\sqrt{2,500,000n}}\right) \end{array}' title='\begin{array}{rll} \Pr(S>1,200n) &=& 1-\Pr(S<1,200n) \\ \\ &=& \displaystyle 1- \Phi\left(\frac{1,200n - 1,000n}{\sqrt{2,500,000n}}\right) \end{array}' class='latex' />

Which implies

The probability corresponds to a value of 1.28. This implies

Solving for we have years. LOL!

Frequency with Respect to Exposure and Coverage Modifications

uclatommy — Thu, 28 Aug 2008 04:56:06 +0000

In a portfolio of risks, there are two types of modifications which can influence the frequency distribution of payments.

Exposure Modification (not in syllabus) — increasing or decreasing the number of risks or time periods of coverage in the portfolio
Coverage Modification — applying limits, deductible or adjusting for inflation in each individual risk

EXPOSURE MODIFICATION

If there is an exposure modification, you would adjust the frequency distribution by scaling the appropriate parameter to reflect the change in exposure. The following list provides the appropriate parameter to adjust for each distribution:

Poisson:
Negative Binomial:
(Geometric is a Negative Binomial with )
Binomial:
(Only valid if the new value remains an integer)

Example 1: You own a portfolio of 10 risks. You model the frequency of claims with a negative binomial having parameters and . The number of risks in your portfolio increases to 15. What are the parameters for the new distribution?

Answer: The frequency distribution now has parameters and Note that since the mean and variance are and respectively, the new mean and variance are multiplied by 1.5.

COVERAGE MODIFICATION

Coverage modifications shift, censor, or scale the individual risks, usually in the presence of a deductible or claim limit, and they change the conditions that trigger a payment. For example, adding a deductible is considered a coverage modification and this changes the condition for payment because any losses below the deductible do not qualify for payment. If the risk is represented by random variable , then adding a deductible would change the random variable to . Scaling in the presence of a deductible or claim limit also affects the frequency distribution. The following lists parameters affected by coverage modifications:

Poisson:
Negative Binomial:
Binomial:
Geometric:

These parameters are scaled by the probability that a payment occurs.

Example 2: The frequency of loss is modeled as a Poisson distribution with parameter . A deductible is imposed so that only 80% of losses result in payments. What is the new distribution?

Answer: It is Poisson with .

Example 3: The frequency of payment is modeled as a negative binomial with parameters and . Losses are pareto distributed with parameters and . The deductible is changed from to . What are the new parameters in the frequency distribution?

Answer: Firstly, is the frequency of payment. So it reflects the current deductible. If you wanted the distribution of without deductible, you would divide by 10)}' title='\Pr{(X>10)}' class='latex' />. Now to find the distribution of with the deductible of 15, you multiply by 15)' title='Pr(X>15)' class='latex' />. To summarize:

15)}{\Pr(X>10)} \\ \\ &=& \displaystyle 0.5\times \frac{0.75614367}{0.82644628} \\ \\ &=& 0.45746692 \end{array}' title='\begin{array}{rll} \beta_{new} &=& \displaystyle \beta_{old}\times\frac{\Pr(X>15)}{\Pr(X>10)} \\ \\ &=& \displaystyle 0.5\times \frac{0.75614367}{0.82644628} \\ \\ &=& 0.45746692 \end{array}' class='latex' />

The Poisson Gamma Mixture Pattern

uclatommy — Sun, 24 Aug 2008 23:22:09 +0000

Suppose a random variable has a frequency distribution that is Poisson with parameter . Suppose the parameter is also a random variable and it has a gamma distribution with parameters and . Then is equivalent to a negative binomial with parameters and .

Note that

When , the gamma distribution is equivalent to an exponential distribution.
This also means the negative binomial has parameter which is equivalent to a geometric distribution.

Pop Quiz!

You own a space mining company and have sent several exploration bots to scout possible mineral rich asteroids. Each bot discovers pockets of valuable resources on different asteroids at a rate of per year. The parameter varies by bot according to an exponential distribution with parameter .

What is the expected number of discoveries per year for a bot chosen at random?
Answer: 3
What is the variance?
Answer: 12

Frequency Models

uclatommy — Sun, 24 Aug 2008 05:56:36 +0000

Frequency models count the number of times an event occurs.

The number of customers to arrive each hour.
The number of coins lucky Tom finds on his way home from school.
How many scientists a Tyrannosaur eats on a certain day.
Etc.

This is in contrast to a severity model which measures the magnitude of an event.

How much a customer spends.
The value of a coin that lucky Tom finds.
The number of calories each scientist provides.
Etc.

The following distributions are used to model event frequency. For notation, means .

Poisson:

0 \end{array}' title='\begin{array}{lr}\displaystyle p_n = e^{-\lambda} \frac{\lambda^n}{n!} & \lambda > 0 \end{array}' class='latex' />

Properties:

Parameter is .
Mean is .
Variance is .
If are Poisson with parameters , then is Poisson with parameter .

Negative Binomial:

0, r>0 \end{array}' title='\begin{array}{lr} \displaystyle p_n = {{n+r-1}\choose{n}}\left(\frac{1}{1+\beta}\right)^r\left(\frac{\beta}{1+\beta}\right)^n & \beta>0, r>0 \end{array}' class='latex' />

Properties:

Parameters are and .
Mean is .
Variance is .
Variance is always greater than the mean.
Is equal to a Geometric distribution when .
If are negative binomial with parameters and , then the sum is negative binomial and has parameters and . Note: ‘s must be the same.

Geometric:

0 \end{array}' title='\begin{array}{lr} \displaystyle p_n = \frac{\beta^n}{\left(1+\beta\right)^{n+1}} & \beta>0 \end{array}' class='latex' />

Properties:

Parameter is .
Mean is .
Variance is .
If are geometric with parameter , then the sum is negative binomial with parameters and .

Binomial:

where is a positive integer, .

Properties:

Parameters are and .
Mean is .
Variance is .
Variance is always less than mean.
If is binomial with parameters and , then the sum is binomial with parameters and .

The (a,b,0) recursion:

These distributions can be reparameterized into a recursive formula with parameters and . When reparameterized, they all have the same recursive format.

It is more common to write

The parameters and are different for each distribution.

Poisson:
and .
Negative Binomial:
and .
Geometric:
and .
Binomial:
and .

Pop Quiz!

A frequency distribution has a = 0.8 and b = 1.2. What distribution is this?
Answer: Negative Binomial because both parameters are positive.
A frequency distribution has mean 1 and variance 0.5. What distribution is this?
Answer: Binomial because the variance is less than the mean.

Bonuses, Dividends, and Refunds

uclatommy — Wed, 20 Aug 2008 23:59:51 +0000

If a policy pays a reward to the participants when losses are below a certain level, this is a particular type of problem which Weishaus calls a “bonus” problem. The bonus, dividend, or refund amount is expressed as a maximum between 0 and the refunded amount. For example, a 15% refund is paid on the difference between the $100 premium and the loss . No refund is paid if losses exceed $100. The refund amount can be expressed as

The key to finding the expected refund is knowing how to manipulate the max function and rewrite it as a min. We can rewrite as

So the expected value is given by