Description: Often actuarial practitioners are faced with working with data that is less than ideal. The data may be observed with gaps in it, a model may suggest variables that are observed at different frequencies, and sometimes predictive analytic results are very fragile to the inclusion or omission of just a few observations in the sample. Data, particularly big data, are often "messy" and something must be done about it. What is the actuary to do about these very practical matters? These types of questions are what this presentation is intended to address. Concerns on missing data, outliers, nonlinearity, mixed-frequency, cross-correlations are illustrated using real datasets in the Asia-Pacific countries. Some possible solutions to the messy data problems will be discussed.

Description: Often actuarial practitioners are faced with working with data that is less than ideal. The data may be observed with gaps in it, a model may suggest variables that are observed at different frequencies, and sometimes predictive analytic results are very fragile to the inclusion or omission of just a few observations in the sample. Data, particularly big data, are often "messy" and something must be done about it. What is the actuary to do about these very practical matters? These types of questions are what this presentation is intended to address. Concerns on missing data, outliers, nonlinearity, mixed-frequency, cross-correlations are illustrated using real datasets in the Asia-Pacific countries. Some possible solutions to the messy data problems will be discussed.