MSTest Runner (via dotnet test) ignores <IsTestingPlatformApplication>false</IsTestingPlatformApplication>

[CoenraadS]

Describe the bug

I have a 'test utility' project, that does not contain any tests, but various helper methods.

I read the issue #4945
and applied OutputType & IsTestingPlatformApplication attributes

<Project Sdk="MSTest.Sdk/3.8.2">

  <PropertyGroup>
    <TargetFramework>net8.0</TargetFramework>
    <ImplicitUsings>enable</ImplicitUsings>
    <Nullable>enable</Nullable>
    <OutputType>Library</OutputType>
    <IsTestingPlatformApplication>false</IsTestingPlatformApplication>

    <TestingPlatformShowTestsFailure>true</TestingPlatformShowTestsFailure>
    <TestingPlatformDotnetTestSupport>true</TestingPlatformDotnetTestSupport>
  </PropertyGroup>

</Project>

Run dotnet test

Expected behavior

All tests except those marked with <TestingPlatformDotnetTestSupport>false</TestingPlatformDotnetTestSupport> are run

Actual behavior

Test utility project runs (and fails because it has no tests)

[Youssef1313]

Thanks for reporting this. @CoenraadS Can you try the 3.9 previews from https://dnceng.pkgs.visualstudio.com/public/_packaging/test-tools/nuget/v3/index.json and/or setting IsTestApplication to false?

@nohwnd I think MSTest.Sdk should change the default value of IsTestApplication. It should be set in targets instead of props. In case of VSTest, we keep the current behavior that it defaults to true. In case of MTP, we should default it to IsTestingPlatformApplication. I'd also tend to prefix it with _ and consider it not intended to be set externally.

[CoenraadS]

Should I use <Project Sdk="MSTest.Sdk/3.9-preview">?

I tried to setup package mapping MSTest.Sdk* to that url but couldn't get the project to load.

[Youssef1313]

@CoenraadS To try out the previews, you'll need to add https://dnceng.pkgs.visualstudio.com/public/_packaging/test-tools/nuget/v3/index.json to your NuGet.config.

The latest preview package version is 3.9.0-preview.25156.2. You can also try to see if setting IsTestApplication to false works with current stable already.

[nohwnd]

https://aka.ms/mstest/preview this is our full guide for previews.

[nohwnd]

@Youssef1313 #4729 (comment) based on the comments from artur here, for .net setting isTestProject might not be enough, do we already handle the test container project capability?

[Youssef1313]

@nohwnd I guess that's different? I'm refering to IsTestApplication, not IsTestProject.

IsTestApplication is an MSTest.Sdk-specific property.

[CoenraadS]

<IsTestApplication>false</IsTestApplication> worked for me :)