The problem
In this chapter, I will first explain a problem to solve and then explain the concepts, while fixing the problem we have. The problem is finding the similarity between two English sentences with three different approaches. To make the comparison fair, we'll use word embeddings in all the implementations. Don't worry, we'll go through word embeddings as well. The problem in hand is commonly called an entailment problem, where we have two sentences at each instance and our job is to predict the similarity between these sentences. We could classify the sentences into three categories:
- Entailment: both sentences mean the same thing:
- A soccer game with multiple males playing.
- Some men are playing a sport.
- Neutral: both sentences have something in common:
- An older and younger man smiling.
- Two men are smiling and laughing at the cats playing on the floor.
- Contradiction: both sentences convey two different meanings:
- A black race car starts up in front of a crowd...