Error when call function: ggml_flash_attn_ext

[paulocoutinhox]

Error:

/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/src/whisper.cpp:2127:23: error: no matching function for call to 'ggml_flash_attn_ext'
                cur = ggml_flash_attn_ext(ctx0, Q, K, V, nullptr, KQscale, 0.0f, 0.0f);
                      ^~~~~~~~~~~~~~~~~~~
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/src/whisper.cpp:1:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/include/whisper.h:4:
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml.h:1772:35: note: candidate function not viable: requires 7 arguments, but 8 were provided
    GGML_API struct ggml_tensor * ggml_flash_attn_ext(
                                  ^
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/src/whisper.cpp:2566:23: error: no matching function for call to 'ggml_flash_attn_ext'
                cur = ggml_flash_attn_ext(ctx0, Q, K, V, KQ_mask_f16, 1.0f, 0.0f, 0.0f);
                      ^~~~~~~~~~~~~~~~~~~
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/src/whisper.cpp:1:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/include/whisper.h:4:
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml.h:1772:35: note: candidate function not viable: requires 7 arguments, but 8 were provided
    GGML_API struct ggml_tensor * ggml_flash_attn_ext(
                                  ^
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/src/whisper.cpp:2648:23: error: no matching function for call to 'ggml_flash_attn_ext'
                cur = ggml_flash_attn_ext(ctx0, Q, Kcross, Vcross, nullptr, KQscale, 0.0f, 0.0f);
                      ^~~~~~~~~~~~~~~~~~~
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/src/whisper.cpp:1:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/whisper/include/whisper.h:4:
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml.h:1772:35: note: candidate function not viable: requires 7 arguments, but 8 were provided
    GGML_API struct ggml_tensor * ggml_flash_attn_ext(
                                  ^

[ggerganov]

The function now accepts one more argument: logit_softcap. Set it to 0.0f and it should work as before