Question About kvcompress

[berryxue]

I use kvcompress to train, but when I infer, I need to convert PixArt to diffusers, there are some errors when I run convert_pixart_to_diffusers.py, How to solve it?

AssertionError: State dict is not empty, odict_keys(['blocks.14.attn.sr.weight', 'blocks.14.attn.sr.bias', 'blocks.14.attn.norm.weight', 'blocks.14.attn.norm.bias', 'blocks.15.attn.sr.weight', 'blocks.15.attn.sr.bias', 'blocks.15.attn.norm.weight', 'blocks.15.attn.norm.bias', 'blocks.16.attn.sr.weight', 'blocks.16.attn.sr.bias', 'blocks.16.attn.norm.weight', 'blocks.16.attn.norm.bias', 'blocks.17.attn.sr.weight', 'blocks.17.attn.sr.bias', 'blocks.17.attn.norm.weight', 'blocks.17.attn.norm.bias', 'blocks.18.attn.sr.weight', 'blocks.18.attn.sr.bias', 'blocks.18.attn.norm.weight', 'blocks.18.attn.norm.bias', 'blocks.19.attn.sr.weight', 'blocks.19.attn.sr.bias', 'blocks.19.attn.norm.weight', 'blocks.19.attn.norm.bias', 'blocks.20.attn.sr.weight', 'blocks.20.attn.sr.bias', 'blocks.20.attn.norm.weight', 'blocks.20.attn.norm.bias', 'blocks.21.attn.sr.weight', 'blocks.21.attn.sr.bias', 'blocks.21.attn.norm.weight', 'blocks.21.attn.norm.bias', 'blocks.22.attn.sr.weight', 'blocks.22.attn.sr.bias', 'blocks.22.attn.norm.weight', 'blocks.22.attn.norm.bias', 'blocks.23.attn.sr.weight', 'blocks.23.attn.sr.bias', 'blocks.23.attn.norm.weight', 'blocks.23.attn.norm.bias', 'blocks.24.attn.sr.weight', 'blocks.24.attn.sr.bias', 'blocks.24.attn.norm.weight', 'blocks.24.attn.norm.bias', 'blocks.25.attn.sr.weight', 'blocks.25.attn.sr.bias', 'blocks.25.attn.norm.weight', 'blocks.25.attn.norm.bias', 'blocks.26.attn.sr.weight', 'blocks.26.attn.sr.bias', 'blocks.26.attn.norm.weight', 'blocks.26.attn.norm.bias', 'blocks.27.attn.sr.weight', 'blocks.27.attn.sr.bias', 'blocks.27.attn.norm.weight', 'blocks.27.attn.norm.bias'])

[lawrence-cj]

KV Compression is not available in diffusers pipeline. We will implement this function later.