Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Review output format for release #9

Open
CharliePoole opened this issue Sep 8, 2016 · 3 comments
Open

Review output format for release #9

CharliePoole opened this issue Sep 8, 2016 · 3 comments
Assignees
Milestone

Comments

@CharliePoole
Copy link
Owner

Before releasing, but after all the templates are created, let's do a general review comparing the output produced by all eight of them for the same assembly. We should eliminate differences that we didn't intend and make sure all the formats work.

@rprouse
Copy link
Contributor

rprouse commented Sep 9, 2016

@CharliePoole said,

You have multiple XML result files and there is no external indication of which ones passed and which one's failed. You use the -brief option with wildcard input and a single file (or the console) for output. The resulting output has just a few lines per test run, which you can easily scan.

That use case makes sense, but to make it usable, we should probably add the test files to the output. As it stands, the summary does not indicate what was tested. We may also want to include the filters.

@CharliePoole
Copy link
Owner Author

@rprouse Yes... I think that's a difference between the V2 and V3 that we'll have to resolve.

@CharliePoole
Copy link
Owner Author

I created a temporary page where we can compare the various output formats at http://nunit.org/nunit-summary/

You can independently select what's displayed on the left and on the right side, choosing from the V2 or V3 console output as well as the eight variations of built in reports.

My own comments:

  • The V2 reports all display a header line showing the name of the file being tested, while V3 reports don't.
  • The V2 and V3 reports have arbitrary differences - that is, there are some differences that result from added features in V3 but others are just different.

Please make your own comparisons and let's discuss.

@CharliePoole CharliePoole removed their assignment Apr 24, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants