Three Approaches to Word Similarity Measures

• Geometric/Spatial to evaluate relative positions of two words in semantic space defined as context vectors 
• Set-based that relies on analysis of overlap of the set of contexts in which words occur 
• Probabilistic using probabilistic models and measures as proposed in information theory