@XJ114514 Could you please change this PR to continue where#3397 left off? We can then tackle the problems that remain one by one.

@XJ114514 Could you please change this PR to continue where#3397 left off? We can then tackle the problems that remain one by one.

I apologize for the trouble. But you already superseded and closed#3397. Is there anything I need to do?

I closed it because the original author didn't respond anymore. But if you're interested you could create a new branch in your repo based on their work and make the changes that were requested in#3397. Please let me know whether you want to proceed that way.

I prefer staying in this PR. The primary goal is to outputdiff info in the console, create test cases, and successfully merge them.

The extra changes requested in#3397:

Shadowing the original external function
Using theme to highlight thediff info
spreadingdiff info to all the Junit API output

should come later as it would be easier once we have one successful example.

I think the diffs need to reference the failures, i.e. something like this (where(2) and(3) reference failures from the list above):

Failures (3):  (1) JUnit Jupiter:AssertionsDemo:groupedAssertions()    MethodSource [className = 'example.AssertionsDemo', methodName = 'groupedAssertions', methodParameterTypes = '']    => org.opentest4j.AssertionFailedError: expected: <2> but was: <3>       org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)       org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)       org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)       org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:150)       org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:145)       org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:531)       example.AssertionsDemo.groupedAssertions(AssertionsDemo.java:52)  (2) JUnit Jupiter:AssertionsDemo:dependentAssertions()    MethodSource [className = 'example.AssertionsDemo', methodName = 'dependentAssertions', methodParameterTypes = '']    => org.opentest4j.AssertionFailedError: expected: <abc> but was: <bcd>       org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)       org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)       org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)       org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)       org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:177)       org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1145)       example.AssertionsDemo.dependentAssertions(AssertionsDemo.java:63)  (3) JUnit Jupiter:AssertionsDemo:standardAssertions()    MethodSource [className = 'example.AssertionsDemo', methodName = 'standardAssertions', methodParameterTypes = '']    => org.opentest4j.AssertionFailedError: expected: <fooooooo> but was: <booooooy>       org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)       org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)       org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)       org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)       org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:177)       org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1145)       example.AssertionsDemo.standardAssertions(AssertionsDemo.java:41)Diffs (Markdown):  (2) JUnit Jupiter:AssertionsDemo:groupedAssertions()   | expected | actual |   | -------- | ------ |   | ~~a~~ | b |   | b | c |   | c | **d** |  (3) JUnit Jupiter:AssertionsDemo:standardAssertions()   | expected | actual |   | -------- | ------ |   | ~~f~~oooooo~~o~~ | **b**oooooo**y** |

WDYT?

I can only get the test's display name (the actual test method name). InMutuableTestExecutionSummary, the rest info is from the parent(s) of thetestIdentifier. I don't see a simple way to do so in other classes. WDYT?

If we list them separately, we should definitely output the same info as done byMutableTestExecutionSummary. I think all we'd need would be aTestExecutionListener that keeps hold of theTestPlan passed totestPlanExecutionStarted which we could use to access information about parent descriptors. Do you think you could give that a try?

If we list them separately, we should definitely output the same info as done byMutableTestExecutionSummary. I think all we'd need would be aTestExecutionListener that keeps hold of theTestPlan passed totestPlanExecutionStarted which we could use to access information about parent descriptors. Do you think you could give that a try?

TheprintFoundTestsSummary() was not called /MutableTestExecutionSummary was not created inConsoleTestExecutor in summary mode. What's worse, thetestPlan was never visible toConsoleTestExecutor
Therefore, I add atestPlan getter toplatform/launcher/listeners/SummaryGeneratingListener.java. Will that create any security issue?

UpdateDiffPrinter to containtestPlan as an attribute and display the testMethod info when printing. Preview is below.

TheprintFoundTestsSummary() was not called /MutableTestExecutionSummary was not created inConsoleTestExecutor in summary mode. What's worse, thetestPlan was never visible toConsoleTestExecutor
Therefore, I add atestPlan getter toplatform/launcher/listeners/SummaryGeneratingListener.java. Will that create any security issue?

Rather than adding it toSummaryGeneratingListener, I'd register another (local) listener for this purpose.

UpdateDiffPrinter to containtestPlan as an attribute and display the testMethod info when printing. Preview is below.

Looks like we're getting closer. We're still missing the(2) etc. references, though.

I don't know how to create a local listener. Could you step in and make one? Sorry for my ignorance.
In CI/CD checks, many tests were ignored and were treated as failed tests in the report after I made the change, do you know what is wrong?
My console output has no(2) reference before each test failure.

I don't know how to create a local listener. Could you step in and make one? Sorry for my ignorance.

For some reason, GitHub didn't let me push a commit to your PR so I opened a PR:XJ114514#1

In CI/CD checks, many tests were ignored and were treated as failed tests in the report after I made the change, do you know what is wrong?

We usePredictive Test Selection so the prior build that ignored them probably didn't select the ones that failed in the most recent build.

My console output has no(2) reference before each test failure.

Sorry for not being clear. I think we should add those there as well.

For some reason, GitHub didn't let me push a commit to your PR so I opened a PR:XJ114514#1

I manually combined the change you made to this PR, but the testPlan from testPlanCapturer is null when using. Can you check about it, sorry I can not offer help because I don't understand how the TestExecutionListener works.

Sorry for not being clear. I think we should add those there as well.

I found thetestIdentifier.getUniqueId() has the sequential numbers at the end and it works for my small test cases.
Would you use thisstandalone generated from current PR to run special cases to see if it will work? You can also generate the standalone by going to the branch and run gradle.
getUniqueId() code:

preview from my two simple test methods

I tried to run the./gradle test since thePredictive Test Selection will skip the tests.
The tests failed because we inserted the diff(markdown) section and ins number reference to the front of the test title - the screenshot below.

1. Should I change the tests or move the diff(markdown) section to the bottom and remove the number reference inSummaryGeneratingListener?
2. The testPlan listener you provided is not workinould we just use the testPlan getter inSummaryGeneratingListener?
   
   

@XJ114514 Let's put this PR on hold for now. I'm currently working on a new HTML report format that would make it much easier to display a diff.