Embeddings: Test Your Knowledge

  1. Which of the following would be good candidates for an embedding? (Choose all that apply)

    Choose as many answers as you see fit.

  2. You encode a database of 100px by 100px black-and-white images of handwritten digits as vectors representing the pixels in the image: 0 for white and 1 for black. If you create an embedding from this encoding, roughly how many dimensions will your embedding have?

  3. Which of the following are benefits of using embedding vectors for feature data over one-hot vectors of the same data? (Choose all that apply)

    Choose as many answers as you see fit.

  4. True or False: Weights taken from a hidden layer of a trained neural network can be used as an embedding.

  5. In what ways does a contextual embedding differ from a static embedding? (Choose all that apply)

    Choose as many answers as you see fit.