Initial proposal for the test-suite automation (#7)

* Initial proposal for the test-suite automation

* Remove Mocking dependency, plus minor pom.xml refactoring

* chore(deps): bump org.apache.maven.plugins:maven-compiler-plugin (#8)

Bumps [org.apache.maven.plugins:maven-compiler-plugin](https://github.com/apache/maven-compiler-plugin) from 3.10.1 to 3.11.0.
- [Release notes](https://github.com/apache/maven-compiler-plugin/releases)
- [Commits](apache/maven-compiler-plugin@maven-compiler-plugin-3.10.1...maven-compiler-plugin-3.11.0)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-compiler-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* new iteration

* add submodules checkout

* closer

* fix the ci

* Add some more context to wast2json failure

* create fault boundary in Machine, catch /byzero err

* equalsIgnoreCase

* cleanup

* download the testsuite instead of using submodule

* cleaning up

* wrapping up

* excludeTests

* cleanup

* more

* increase the CI coverage

* more

* failing on win

* try to fix win

* finalize

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Benjamin Eckel <[email protected]>

.github/workflows/ci.yaml

@@ -10,10 +10,12 @@ jobs:
   ci:
     name: CI
     runs-on: ${{ matrix.os }}
+    continue-on-error: true
     strategy:
+      fail-fast: false
       matrix:
-        os: [ubuntu-latest]
-        version: [11]
+        os: [ubuntu-latest, macos-latest, windows-latest]
+        version: [11, 17]
     steps:
       - name: Checkout sources
         uses: actions/checkout@v4
@@ -23,4 +25,4 @@ jobs:
           distribution: 'temurin'
           java-version: '${{ matrix.version }}'
       - name: Test Java
-        run: mvn -B verify
+        run: mvn -B install

.gitignore

@@ -1,2 +1,3 @@
 .idea/
 target/
+testsuite/

pom.xml

@@ -25,6 +25,7 @@
   </properties>
 
   <modules>
+    <module>test-gen-plugin</module>
     <module>wasm</module>
     <module>runtime</module>
   </modules>

runtime/pom.xml

@@ -24,4 +24,37 @@
       <artifactId>junit</artifactId>
     </dependency>
   </dependencies>
+
+
+  <build>
+    <plugins>
+      <plugin>
+        <groupId>com.dylibso.chickory</groupId>
+        <artifactId>test-gen-plugin</artifactId>
+        <version>${project.version}</version>
+        <executions>
+          <execution>
+            <goals>
+              <goal>wasm-test-gen</goal>
+            </goals>
+          </execution>
+        </executions>
+        <configuration>
+          <wastToProcess>
+            i32.wast,
+            i64.wast,
+            return.wast
+          </wastToProcess>
+          <excludedTests>
+            SpecV1ReturnTest.test6,
+            SpecV1ReturnTest.test7,
+            SpecV1ReturnTest.test9,
+            SpecV1ReturnTest.test49,
+            SpecV1ReturnTest.test55
+          </excludedTests>
+        </configuration>
+      </plugin>
+    </plugins>
+  </build>
+
 </project>

runtime/src/main/java/com/dylibso/chicory/runtime/ExportFunction.java

@@ -1,5 +1,6 @@
 package com.dylibso.chicory.runtime;
 
+import com.dylibso.chicory.wasm.exceptions.ChicoryException;
 import com.dylibso.chicory.wasm.types.Value;
 
 /**