Replace current regex engine with PCRE2

[Rot127]

Your checklist for this pull request

• I've read the guidelines for contributing to this repository
• I made sure to follow the project's coding style
• I've documented or updated the documentation of every function and struct this PR changes. If not so I've explained why.
• I've added tests that prove my fix is effective or that my feature works (if possible)
• I've updated the rizin book with the relevant information (if needed)

Detailed description

Replace the current regex engine with PCRE2.

Test plan

All green.

Closing issues

closes #3730

Partially addresses #4055

Todo

• Add a rz_vector_pop_ptr() function which doesn't use memcpy() and use it in match_all_flat(). Or add a rz_vector_concat() function with the same functionality.
• Terminology for groups and matches is weird.
• docs
• Open bug report for tcc and pcre2 compilation and __asm
• Test rz_regex_get_match_name

[XVilka]

1. Please send it from dist- branch from rizinorg account, to check that it builds and runs fine on all supported platforms and configurations
2. Once it's done, I think it is worth removing the old implementation as well.

[wargio]

would be nice to also allow PCRE (v1) for older distro

[Rot127]

would be nice to also allow PCRE (v1) for older distro

Currently for every distro which has no pcre2 it is compiled as subproject. Shouldn't this be enough?

[XVilka]

would be nice to also allow PCRE (v1) for older distro

Currently for every distro which has no pcre2 it is compiled as subproject. Shouldn't this be enough?

Yes, I think it should be enough. We have the same strategy for Capstone dependency as well.

[Rot127]

The PCRE2 defines a huge amount of options and flags. Is it fine if we do not add an RZ_REGEX_... variant for each of it? Simply to avoid duplicates?
Or is it always preferable to have our API consistently named?

[wargio]

you should only use PCRE2_CASELESS | PCRE2_MULTILINE
where caseless is applied only if the grep configuration is auto or case insensitive.

[Rot127]

Tests/build still fail, but I'd like to know your opinion on the API first. Because now there are some changes in actual code now.

[XVilka]

Please also fix test\db\archos\windows-x64\dbg_dts - remove \n or just don't include it in the capture.
macOS (Darwin) regexes should be fixed too, in particular with whitespace and newlines handling: https://ci.rizin.re/repos/27/pipeline/4083/7#L616

OpenBSD error message is puzzling:

ERROR: Regex compilation failed at 0: no more memory

Same happens on NetBSD too.

[Rot127]

Yep, aware of it. Just wait and bundle it with other fixes, so the CI is not triggered again and again.

[Rot127]

BSD problems seem to be a bug in PCRE2 (https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=276252). Hopefully only affecting the JIT compiler?

Going make a minimal example and open an issue later. If it is indeed a BSD only problem, I would just exclude BSD from JIT/

[XVilka]

@Rot127 yes, though FreeBSD works just fine. The problem occurs only in OpenBSD and NetBSD, please disable JIT only for those, but not the FreeBSD.

[XVilka]

Once this PR is green after the rebase, please send one from the dist-fuzz- branch, to check all configurations. Also, do you want to squash all those commits into one?

[Rot127]

Also, do you want to squash all those commits into one?

Absolutely. The commit history is a mess

[Rot127]

Should be fixed now.

[XVilka]

@Rot127 please send a new PR from inside the rizinorg account with the dist-fuzz- branch to trigger everything.