Double-quote parsing during string interpolation differs from jq

[kanaka]

Describe the bug

Version of yq: 4.44.3
Operating system: ubuntu 24.04
Installed via: curl

Input Yaml
data1.yml:

data:
  - "abc"
  - "def"

data1.json:

{"data":["abc","def"]}

Command
The command you ran:

yq '"\(.data | join(" "))"' ./data1.yml

Actual behavior

Error: bad expression, please check expression syntax

Expected behavior

"abc def"

Additional context
Using jq on the json of the same data works fine:

$ jq '"\(.data | join(" "))"' ./data1.json
"abc def"

Also, escaping the inner double quotes will make it work in yq, but it will break in jq. I suspect this means that the yq parsing of strings is looking for the first unescaped double-quote in the string but it should be skipping any double-quotes that are within interpolation sections \(....).

[kanaka]

Looks like the problem is here:

yq/pkg/yqlib/lexer_participle.go

Line 185 in 6eb2ae7

{"QuotedStringValue", `"([^"\\]*(\\.[^"\\]*)*)"`, stringValue(), 0},

I don't think pure regex will be able to handle parsing interpolated strings because you will need to keep track of the paren wrapping depth of commands inside of interpolation blocks, i.e. I believe something like this is legal syntax in jq: "prefix\(func1(func2(func3("blah"))))suffix"