CloudBeat Docs
HomeRequest a DemoContactSign In
  • What is CloudBeat?
  • Get Started
    • Quick Start
  • SUPPORTED FRAMEWORKS
    • Java JUnit
    • .NET MSTest
    • Playwright (JS/TS)
  • Fundamentals
    • Creating Projects
    • Creating Environments
    • Creating Tests Cases
    • Running Tests Cases
    • Creating Tests Suites
    • Running Tests Suites
    • Creating Releases
    • Adding Apps
  • Sample Projects
    • Introduction to Cloudbeat sample projects
    • Oxygen Cucumber project
    • Oxygen project
    • TestNG project
  • Features
    • Integrations
      • CI/CD Pipeline
        • Jenkins
        • Azure DevOps
      • Cloud Providers
        • Genymotion
        • Applitools
        • Perfecto
    • Supported Frameworks
    • Data-Driven Testing
      • DDT - Oxygen Framework
  • CloudBeat Synthetic
    • What is CloudBeat Synthetic?
    • Creating your first monitor
    • Review general monitor results
    • Review specific monitor dashboard
    • Create SLA
    • Create Reports & Alerts
    • Changing Runtime Setting
    • Run Monitors
    • Maintenance
    • Incidents
    • Full Monitor Test - Example
  • Settings & Administration
    • Managing Notification Groups
    • Managing Permissions
    • Managing Users
    • Managing Account
    • Managing My Profile
  • References
    • Active Runs
    • Test Results
    • Projects
      • Oxygen Project
      • Cucumber + Java Project
      • .Net Project
      • TestNG Project Setup
    • Reports
Powered by GitBook
On this page
  • Prerequisites
  • Cloudbeat API Key
  • Test Case ID
  • Test Type
  • Azure Pipeline
  • Define Variables
  • Add Agent Job
  • Install Cloudbeat CLI
  • Run Test Case
  • Publish Test Results
  • Run Pipeline

Was this helpful?

  1. Features
  2. Integrations
  3. CI/CD Pipeline

Azure DevOps

Integrating Azure with CloudBeat enables automated cloud testing within your CI/CD pipeline. It streamlines test execution, provides detailed reporting, and ensures faster feedback.

PreviousJenkinsNextCloud Providers

Last updated 6 months ago

Was this helpful?

Prerequisites

In order to run a test case, we need 3 things: Cloudbeat API Key, test case id and test type.

Cloudbeat API Key

To find your api key, go to Account > Settings > Security

or follow this link:

Test Case ID

To find a case id simply open cases and open the case you want to run.

Test Type

You can choose between a case, which is used for a singular test, or suite for multiple tests.

Azure Pipeline

Start by creating a new pipeline in Azure

  • Log In and Navigate

  • Go to Pipelines

    • Click on Pipelines in the left-hand menu, then choose New Pipeline.

  • Select Source Repository

    • Choose the repository where your code is stored (e.g., Azure Repos or GitHub).

  • Choose the Classic Editor

    • When setting up the pipeline, select Use the Classic Editor instead of YAML.

  • Configure Pipeline Settings

    • Set the pipeline name (e.g., Cloudbeat-cli Run Test Example).

    • Under Agent Pool, choose Azure Pipelines and select the Agent Specification (e.g., ubuntu-22.04).

  • Select the Repository Source:

    • In the pipeline editor, under Get Sources, click the edit icon.

    • Choose GitHub (or another repository type based on your project).

  • Authorize the Connection:

    • If GitHub is selected, ensure it’s authorized using an access token. Click Change to modify or reauthorize if necessary.

  • Set Repository and Branch:

    • Repository: Select the specific GitHub repository (e.g., oxygenhq/docs).

    • Default Branch: Specify the branch to build from (e.g., refs/heads/master).

  • Adjust Source Settings:

    • Clean: Set to false (default) to avoid cleaning the workspace before building. Change to true if a fresh workspace is needed for every run.

    • Tag Sources: Choose whether to tag the repository:

      • Never: Don’t tag builds (default).

      • On Success: Tag only successful builds.

      • Always: Tag every build.

  • Report Build Status:

    • Check the box to report the build status back to GitHub.

Define Variables

You can create variables to store data such as API keys and other data to use across the tasks.

Add Agent Job

First we need to add a command which will install the cloudbeat cli

Install Cloudbeat CLI

Add a command line task, name it "Install @cloudbeat/cli"

Add the script:

npm install -g @cloudbeat/cli

Run Test Case

To run our test, we need to add another command line and pass in the test type, id, and api key:

cloudbeat-cli start testType testId --apiKey=apiKey

But since we defined our variables, we can add this to the script:

cloudbeat-cli start $(cbTestType) $(cbTestId) --apiKey=$(cbApiKey)

when the test ends, it will create an JUnit XML results file

Publish Test Results

Lastly we need to publish the results. Add another task called "Publish Test Results":

Run Pipeline

Press on Queue and Run

Inside Cloudbeat, you will see the test case starting

After it's finished, you can see the results by following the link under Publish Test Results:

Go to , log in, and open your project.

Azure DevOps
https://app.cloudbeat.io/#/settings/security/