This is compiled using[tests\fsharp\FSharp.Tests.FSharpSuite.fsproj](tests/fsharp/FSharp.Tests.FSharpSuite.fsproj) to a unit test DLL which acts as a driver script. Each individual test is an NUnit test case, and so you can run it like any other NUnit test.

Tests are grouped in folders per area. Each test compiles and executes a`test.fsx|fs` file in its folder using some combination of compiler or FSI flags specified in the FSharpSuite test project.

If the compilation and execution encounter no errors, the test is considered to have passed.

If the compilation and execution encounter no errors, the test is considered to have passed.

There are also negative tests checking code expected to fail compilation.

See note about baseline under "Other Tips" bellow for tests checking expectations against "baseline" files.

* Run as Administrator, or a handful of tests will fail

Do this, or a handful of tests will fail.

* NGen-ing the F# bits (fsc, fsi, FSharp.Core, etc) will result in tests executing much faster. Make sure you run`src\update.cmd` with the`-ngen` flag before running tests.

* The FSharp and FSharpQA suites will run test cases in parallel by default. You can comment out the relevant line (look for`PARALLEL_ARG`) to disable this.

* By default, tests from the FSharpQA suite are run using a persistent, hosted version of the compiler. This speeds up test execution, as there is no need for the`fsc.exe` process to spin up repeatedly. To disable this, uncomment the relevant line (look for`HOSTED_COMPILER`).

FSharp Test Suite works with couples of .bsl (or .bslpp) files considered "expected" and called baseline, those are matched against the actual output which resides under .err or .vserr files of same name at the during test execution.

When working on changes generating conflicts with the baseline, you can use the helper script[tests/fsharp/update.base.line.with.actuals.fsx](tests/fsharp/update.base.line.with.actuals.fsx) to update all .bsl based on the matching .err file.

When doing so keep in mind to carefully review the diff before comitting updated baseline files.

* Making the tests run faster

* NGen-ing the F# bits (fsc, fsi, FSharp.Core, etc) will result in tests executing much faster. Make sure you run`src\update.cmd` with the`-ngen` flag before running tests.

* The FSharp and FSharpQA suites will run test cases in parallel by default. You can comment out the relevant line (look for`PARALLEL_ARG`) to disable this.

* By default, tests from the FSharpQA suite are run using a persistent, hosted version of the compiler. This speeds up test execution, as there is no need for the`fsc.exe` process to spin up repeatedly. To disable this, uncomment the relevant line (look for`HOSTED_COMPILER`).

.bslpp (baseline pre-process) files are specially designed to enable substitution of certain tokens to generate the .bsl file. You can look further about the pre-processing logic under[tests/fsharp/TypeProviderTests.fs](tests/fsharp/TypeProviderTests.fs), this is used only for type provider tests for now.

<CompileInclude="tests.fs" />

<ContentInclude="packages.config" />

<NoneInclude="app.config" />

<NoneInclude="update.base.line.with.actuals.fsx" />

</ItemGroup>

<ItemGroup>

<ReferenceInclude="mscorlib" />

|> List.map(fun d-> Path.Combine(__SOURCE_DIRECTORY__, d)|> DirectoryInfo)

for din directoriesdo

for pin extensionPatternsdo

for errFilein d.GetFiles pdo

letbaseLineFile= FileInfo(Path.ChangeExtension(errFile.FullName,"bsl"))

letbaseLineFilePreProcess= FileInfo(Path.ChangeExtension(errFile.FullName,"bslpp"))

if File.ReadAllText(errFile.FullName)<> File.ReadAllText(baseLineFile.FullName)then

if baseLineFilePreProcess.Existsthen baseLineFilePreProcess

else baseLineFile

printfn"%s not matching, replacing with%s" expectedFile.FullName errFile.FullName

errFile.CopyTo(expectedFile.FullName,true)|> ignore