Guangning Yu

2557 days ago

Negative sampling is one of the ways of addressing this problem- just select a couple of contexts c1 at random. The end result is that if cat appears in the context of food, then the vector of food is more similar to the vector of cat (as measures by their dot product) than the vectors of several other randomly chosen words (e.g. democracy, greed,freddy), instead of all other words in language.

What is negative sampling? - Quora

quora.com