Output diff of expected and actual values in `ConsoleLauncher` #4017

XJ114514 · 2024-09-23T12:09:56Z

Overview

Current PR can successfully build and generate `junit-platform-console-standalone-1.12.0-SNAPSHOT.jar` containing diff outputs for two different Strings to the console.

Changes made in this draft PR:

add diff function to junit-platform-console/.../tasks/ConsoleTestExecutor.java (output of console)
add dependency to libs.versions.toml and junit-platform-console.gradle.kts of junit-platform-console
add changed that will be made to release-notes-5.12.0-M1.adoc

Tasks that need to finish

add package documentation to junit-platform-console/.../module-info.java (causing testing failure because the auto test cases can not find the diff package)
add auto test cases for diff output in ConsoleTestExecutorTests.java

I hereby agree to the terms of the JUnit Contributor License Agreement.

Definition of Done

There are no TODOs left in the code
Method preconditions are checked and documented in the method's Javadoc
Coding conventions (e.g. for logging) have been followed
Change is covered by automated tests including corner cases, errors, and exception handling
Public API has Javadoc and @API annotations
Change is documented in the User Guide and Release Notes

continue from #3397
Issue: #3139

Tasks completed: 1. Locate ConsoleLauncher output 2. Check if actual and expected of AssertionFailedError are both type of CharSequence To do list: 1. Add diff function dependency 2. Using diff to generate the output desired Issue: junit-team#3139

Tasks completed: 1. Locate ConsoleLauncher output 2. Check if actual and expected of AssertionFailedError are both type of CharSequence 3. Add diff function dependency 4. Using diff to generate the output desired Issue: junit-team#3139

delete one line of extra code

Fixed different profile issue. Tasks completed: 1. Locate ConsoleLauncher output 2. Check if actual and expected of AssertionFailedError are both type of CharSequence 3. Add diff function dependency 4. Using diff to generate the output desired ToDo: 1.Automatic test case for diff output Issue: junit-team#3139

Issue: junit-team#3139

Add external diff module to module documentation For unknown reason, the test cases can not find the external module while the gradle can build normally. Issue: junit-team#3139

marcphilipp · 2024-09-23T13:30:09Z

@XJ114514 Could you please change this PR to continue where #3397 left off? We can then tackle the problems that remain one by one.

XJ114514 · 2024-09-24T11:55:33Z

@XJ114514 Could you please change this PR to continue where #3397 left off? We can then tackle the problems that remain one by one.

I apologize for the trouble. But you already superseded and closed #3397. Is there anything I need to do?

marcphilipp · 2024-09-24T12:54:38Z

I closed it because the original author didn't respond anymore. But if you're interested you could create a new branch in your repo based on their work and make the changes that were requested in #3397. Please let me know whether you want to proceed that way.

XJ114514 · 2024-09-24T19:05:12Z

I prefer staying in this PR. The primary goal is to output diff info in the console, create test cases, and successfully merge them.

The extra changes requested in #3397:

Shadowing the original external function
Using theme to highlight the diff info
spreading diff info to all the Junit API output

should come later as it would be easier once we have one successful example.

marcphilipp

The extra changes requested in #3397:

Shadowing the original external function
Using theme to highlight the diff info
spreading diff info to all the Junit API output

should come later as it would be easier once we have one successful example.

We usually only merge complete PRs that leave main ready to be released. But I can help with the shadowing.

gradle/libs.versions.toml

marcphilipp · 2024-09-25T06:15:16Z

junit-platform-console/src/main/java/org/junit/platform/console/tasks/ConsoleTestExecutor.java

@@ -180,11 +186,39 @@ private Optional<TestExecutionListener> createXmlWritingListener(PrintWriter out
 	private void printSummary(TestExecutionSummary summary, PrintWriter out) {
 		// Otherwise the failures have already been printed in detail
 		if (EnumSet.of(Details.NONE, Details.SUMMARY, Details.TREE).contains(outputOptions.getDetails())) {
+			//adding diff code here


This should be done in place where we print the exceptions (as it is in #3397). Otherwise, it would be difficult to find the test that belongs to the diff in case of multiple failing tests.

Which part do you wish to change? The first print happens in DefaultLaucher and the second happens in MutableTestExecutionSummary. Both are in junit-platform-laucher module. Changes will affect all Junit API output I believe?
I can try to work on it over the weekend if you wish.
At the same time, can you help to find why the package documentation test case fails (Test cases can not find diff package once I add it to the module-info.java for documentation)

We also need to make sure that the diff is printed if a details mode other than Details.NONE, Details.SUMMARY, or Details.TREE is used. We should be able to extract the diff-printing code to a separate class and call it from MutableTestExecutionSummary, and the other listeners (FlatPrintingListener etc.).

We also need to make sure that the diff is printed if a details mode other than Details.NONE, Details.SUMMARY, or Details.TREE is used. We should be able to extract the diff-printing code to a separate class and call it from MutableTestExecutionSummary, and the other listeners (FlatPrintingListener etc.).

TBH, I do not know what you meant by the "details mode." All I did so far was dive into the code, find the corresponding output location of the console, and modify it. Is there a Javadoc or class diagram or something similar I can use to learn how the Junit5 handles output?

XuJ321 and others added 13 commits August 31, 2024 18:25

Issue: junit-team#3139 part 1

e0d2849

Tasks completed: 1. Locate ConsoleLauncher output 2. Check if actual and expected of AssertionFailedError are both type of CharSequence To do list: 1. Add diff function dependency 2. Using diff to generate the output desired Issue: junit-team#3139

Issue: junit-team#3139 part 2

bc1b464

Tasks completed: 1. Locate ConsoleLauncher output 2. Check if actual and expected of AssertionFailedError are both type of CharSequence 3. Add diff function dependency 4. Using diff to generate the output desired Issue: junit-team#3139

Issue: junit-team#3139 part 2 update

2fa9a8e

delete one line of extra code

Merge branch 'junit-team:main' into main

e8d11bd

Fix format issue

7b4088d

fix build documentation issue

bb29695

trying to fix the build error

2c27b53

Try to Fix Dependency issue

af16685

Issue: junit-team#3139

Issue: junit-team#3139 Add external diff module to module documentation

3d73d1e

Add external diff module to module documentation For unknown reason, the test cases can not find the external module while the gradle can build normally. Issue: junit-team#3139

Merge branch 'junit-team:main' into main

c8a7b95

Remove module-info.java documentation for testing

53d884c

Run spotless and do final testing before draft PR

26bcaa4

marcphilipp linked an issue Sep 23, 2024 that may be closed by this pull request

ConsoleLauncher should output diff of expected and actual String values #3139

Open

marcphilipp marked this pull request as draft September 23, 2024 13:30

marcphilipp mentioned this pull request Sep 23, 2024

Add diff section to report of AssertionFailedError failures #3397

Closed

6 tasks

sbrannen added type: enhancement theme: reporting component: Platform labels Sep 23, 2024

sbrannen changed the title ~~Issue: junit-team#3139 Draft PR~~ Output diff of expected and actual values in ConsoleLauncher Sep 23, 2024

marcphilipp requested changes Sep 25, 2024

View reviewed changes

Update libs.versions.toml

3248752

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Output diff of expected and actual values in `ConsoleLauncher` #4017

Output diff of expected and actual values in `ConsoleLauncher` #4017

XJ114514 commented Sep 23, 2024 •

edited

Loading

marcphilipp commented Sep 23, 2024

XJ114514 commented Sep 24, 2024

marcphilipp commented Sep 24, 2024

XJ114514 commented Sep 24, 2024

marcphilipp left a comment

marcphilipp Sep 25, 2024

XJ114514 Sep 25, 2024

marcphilipp Sep 26, 2024

XJ114514 Sep 27, 2024

Output diff of expected and actual values in ConsoleLauncher #4017

Are you sure you want to change the base?

Output diff of expected and actual values in ConsoleLauncher #4017

Conversation

XJ114514 commented Sep 23, 2024 • edited Loading

Overview

Current PR can successfully build and generate junit-platform-console-standalone-1.12.0-SNAPSHOT.jar containing diff outputs for two different Strings to the console.

Definition of Done

marcphilipp commented Sep 23, 2024

XJ114514 commented Sep 24, 2024

marcphilipp commented Sep 24, 2024

XJ114514 commented Sep 24, 2024

marcphilipp left a comment

Choose a reason for hiding this comment

marcphilipp Sep 25, 2024

Choose a reason for hiding this comment

XJ114514 Sep 25, 2024

Choose a reason for hiding this comment

marcphilipp Sep 26, 2024

Choose a reason for hiding this comment

XJ114514 Sep 27, 2024

Choose a reason for hiding this comment

Output diff of expected and actual values in `ConsoleLauncher` #4017

Output diff of expected and actual values in `ConsoleLauncher` #4017

XJ114514 commented Sep 23, 2024 •

edited

Loading

Current PR can successfully build and generate `junit-platform-console-standalone-1.12.0-SNAPSHOT.jar` containing diff outputs for two different Strings to the console.