Learn how Estimation works in Azure DevOps Parallel Jobs

Learn how Estimation works in Azure DevOps Parallel Jobs

Parallel jobs help streamline builds and releases by executing multiple tasks concurrently. Estimating the number of parallel jobs required depends on several factors, such as the complexity of the pipeline, resource availability, and performance needs.

1. Simple Estimate

Simple Approach:

Start by estimating the number of parallel jobs based on the critical tasks in the pipeline.

For example, if you have a pipeline with unit tests, integration tests, and builds, you might consider:

• 1 job for build

• 1 job for unit tests

• 1 job for integration tests

Thus, requiring 3 parallel jobs.

2. Detailed Estimate

For a more detailed estimate:

Factors:

• Number of stages and jobs per stage

• Complexity of tasks (e.g., test suites, deployments)

• Resource capacity (number of agents or infrastructure available)

• Performance expectations (speed vs. resource utilization)

Example Calculation:

Assume:

• 5 stages in a pipeline

• Each stage has 3 jobs

• Each job involves different compute-heavy tasks (e.g., builds, tests, deployments)

In this case, 15 parallel jobs are needed (5 stages × 3 jobs).

3. View Available Parallel Jobs

To view and manage parallel jobs in Azure DevOps:

1. Navigate to Organization Settings > Pipelines > Parallel Jobs.

2. Here, you can:

   • Adjust maximum parallel jobs across the organization.

   • Monitor usage and limits.

   • Set limits based on agent capabilities, environments, or specific project needs.

4. Location of Parallel Jobs in Organization Settings

Parallel jobs are managed at the organization level. You can set limits for how many parallel jobs are available across all projects within the organization.

Steps:

1. Go to Organization Settings.

2. Select Pipelines > Parallel Jobs.

3. Configure job limits based on need (e.g., per collection, per environment).

5. Sharing Parallel Jobs Across Projects in a Collection

Azure DevOps allows sharing of parallel jobs across multiple projects within a collection. This is useful when resources are limited or when consolidating workloads.

Sharing Parallel Jobs:

1. Navigate to Organization Settings > Pipelines > Parallel Jobs.

2. Use the option to share jobs across projects within a collection.

This allows efficient use of resources and simplifies management across multiple projects.

Summary

1. Simple Estimate: Based on tasks in the pipeline (e.g., build, test, deployment jobs).

2. Detailed Estimate: Based on stages, complexity, and available resources.

3. Viewing and Managing Parallel Jobs: Can be done at the organizational level, accessible through the organization settings.

4. Sharing Across Projects: Allows parallel jobs to be shared between multiple projects within a collection to optimize resource usage.