Description: Basic feature engineering uses input data to create dummy variables, log transforms, and other single-value transformations. This talk builds upon these univariate transformations and presents several strategies for creating complex multivariate features that can enhance your model's lift. Topics such as target encoding, dimension reduction/projection, row/column, and other feature engineering topics will be covered.

Description: Spark offers a way to get some dramatic speed and scalability advantages over the Map-reduce methodology whenever you are doing iterative data processing and particularly when you want interactive data analysis capability. Find out why “lazy execution” can be a desirable characteristic when dealing with big data.