Subject: [Nmlrg] new ways of dealing with sparse categorical data like IP addresses (Google Wide & Deep)

From: David Meyer <[email-masked]>
Date: Wed, 29 Jun 2016 11:48:24 -0700

Check out Wide & Deep:
https://research.googleblog.com/2016/06/wide-deep-learning-better-together-with.html

Among other things, Wide & Deep is

"useful for generic large-scale regression and classification problems with
sparse inputs (categorical features with a large number of possible feature
values), such as recommender systems, search, and ranking problems."

In the network space we have many such sparse categorical features such as
IPv{4,6} addresses. Wide & Deep might give us a few  hints about how we
might approach this problem.

--dmm