Skip to content

Text to Image Generation Grounded by Fine-Grained User Attention (Jing Yu Koh et. al) Implemention of Sequence Labeling with Pixel Semantics, Section 2.1

Notifications You must be signed in to change notification settings

gordon-lim/Sequence-Tagging

Repository files navigation


Sequence Tagging

Text to Image Generation Grounded by Fine-Grained User Attention (Jing Yu Koh et. al)
Implemention of Sequence Labeling with Pixel Semantics, Section 2.1

Questions

  • How to deal with P(w|None) from IBMModel1?
  • Why use IBMModel1 when we already have the alignments between words and labels
  • How did the authors initialize the start probablities in the HMM
  • How may I use Add-1 smoothing with IBMModel1 from nltk
  • Does "bag of image labels" refer to all labels annotated in the image?

TODOs

  • Use Add-1 smoothing on translation probabilities
  • Align transmission and emission matrices by label
  • Modify Viterbi to allow constraints and scaled contributions of transition probabilities
  • Auto-Supervised Training on BERT model to perform tagging

References

About

Text to Image Generation Grounded by Fine-Grained User Attention (Jing Yu Koh et. al) Implemention of Sequence Labeling with Pixel Semantics, Section 2.1

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published