What are the most common transformations when the target variable is not normally distributed?

The most common transformation in the case of a skewed response variable is to take its logarithm. In the case of a right skewed variable, such as income, this often reduces the spread so that more points are clustered towards the median of the transformed distribution, which is to be expected for a Gaussian distribution. Another transformation technique is to use a power-based approach, such as the Box-Cox transformation. This method searches a range of exponents to find the value that most closely transforms the variable into a Gaussian distribution. Upon finding the power ƛ that makes the distribution most normal, the transformation applied is of the form: 

When taking any transformation, it is important to remember that inference must be updated to reflect the new units being modeled, and in the case of complex power transformations, interpretation becomes less clear. However, a special case is the log-log model, in which both the response and predictor variable are transformed via a logarithm. The model then has a nice interpretation of the percentage change in Y based on a 1-percent change in X, which is referred to as elasticity. 

Author

Help us improve this post by suggesting in comments below:

– modifications to the text, and infographics
– video resources that offer clear explanations for this question
– code snippets and case studies relevant to this concept
– online blogs, and research publications that are a “must read” on this topic

Leave the first comment

Partner Ad
Find out all the ways that you can
Contribute