Getting automated tests executed after deployment actions, it self is challenging with release management. Below are some helpful links on “how to overcome them”.
Resolve Common Errors - Run Automated Tests with VS Release Management 2013
Disable Lock Screen on Windows 8.1 to Prevent - Automation engine is unable to playback the test because it is not able to interact with the desktop
Increase Default Timeout of Copying Test Binaries to Test Client – Allow Release Management to Run Tests with Increased Timeout
Once everything in place, with a customized TcmExec.ps1, tests get executed with RM.
Wouldn’t it be nice to have an email delivered to the team with the test results like shown below?
To do this it is possible to modify the TcmExec.ps1 (How to get the TcmExec.ps1 is described here), to read the details of the test result file (.trx) and create a formatted email message to sent to the defined recipients. As the first step script is introduced with few more parameters.
Extract the build number from the build location path given that the build path contains it.This is to make Test result email look nicer if the build number is not supplied by build TM server.
Extract test result details into a temp table to format it for the email.
Send email and print result in output log of RM action.
Avoid failing the Release Management Action, even if failing tests found when the email send option is set to true. This will make sure deployment completes and the required team members are informed of the Test Results. and give them the option of proceeding or stopping the release pipeline to next steps, after evaluating test results.
Setup a custom tool in RM using the PowerShell script TcmExec.ps1.
If components are already created with the tool they need to be updated with new parameters manually.
Set up the release template to use the test runner with new parameters. All other common issues mentioned at the linked post in the beginning of this post.
Tests are getting executed in TFS lab environment with RM.
Release management action output log has the details of the test printed.
Email with the test results sent to the defined recipients.
You can download the enhanced TcmExec.ps1 from TechNet Gallery.
It is great if the latest updates to TFS can be applied as and when they are released. But for a large organization it might not be sometime...
You needed to setup dedicated machines for testing when using Run Functional Tests and you had to execute, Deploy Test Agent step and Copy...
Generally windows services are deployed by creating an msi installer. It is possible to deploy msi via VSTS/TFS release management using the...
If you have upgraded the TFS from TFS 2015 to TFS 2018 you will encounter a situation where your vNext build agents 1.xx are no longer valid...
TFS 2018 RC1 is now available and you can download it from https://www.visualstudio.com/downloads/ . Release note here explains the new fea...