Skip to content

Latest commit

 

History

History
37 lines (30 loc) · 1.58 KB

README.md

File metadata and controls

37 lines (30 loc) · 1.58 KB

Sequence Tagging

Text to Image Generation Grounded by Fine-Grained User Attention (Jing Yu Koh et. al)
Implemention of Sequence Labeling with Pixel Semantics, Section 2.1

Questions

  • How to deal with P(w|None) from IBMModel1?
  • Why use IBMModel1 when we already have the alignments between words and labels
  • How did the authors initialize the start probablities in the HMM
  • How may I use Add-1 smoothing with IBMModel1 from nltk
  • Does "bag of image labels" refer to all labels annotated in the image?

TODOs

  • Use Add-1 smoothing on translation probabilities
  • Align transmission and emission matrices by label
  • Modify Viterbi to allow constraints and scaled contributions of transition probabilities
  • Auto-Supervised Training on BERT model to perform tagging

References