ADO Tools

Azure DevOps Productivity Suite - User Guide

ADO Tools is a Windows desktop application that helps you work with Azure DevOps more efficiently. It brings together work item browsing, intelligent search, attachment downloads, and software build management into a single, modern interface.

The application has three main tabs:

TabWhat it does
Work ItemsBrowse Azure DevOps queries, search across your backlog using AI-powered semantic search or keyword matching, download work item attachments, and find similar work items.
Software DownloadsList available builds from Azure DevOps pipelines, download artifacts, and install or update software with one click.
SettingsConfigure your Azure DevOps connection, set download folders, and build/manage the search index.
The main ADO Tools window showing the three tabs The main ADO Tools window with the three tab headers: Work Items, Software Downloads, and Settings.
Tip All your settings, column layouts, window size, and search history are saved automatically and restored when you reopen the application.

Getting Started

First Launch

When you open ADO Tools for the first time, you need to configure your Azure DevOps connection. Navigate to the Settings tab to get started.

Setting Up Your Connection

  1. Go to the Settings tab.
  2. Enter your Azure DevOps Organisation name (e.g., myorg).
  3. Enter your default Project name (e.g., civil).
  4. Paste your Personal Access Token (PAT) into the password field.
  5. Click Validate Connection to test. A green success message confirms it is working.
Settings tab Connection card The Connection card with Organisation, Project, and PAT fields, showing a green validation message.
What is a PAT? A Personal Access Token is a secure way to authenticate with Azure DevOps without using your password.

How to create a PAT:

  1. Open your browser and go to https://dev.azure.com/bentleycs.
  2. Click your profile icon (top-right corner) and select "Personal access tokens". Or go directly to: https://dev.azure.com/bentleycs/_usersSettings/tokens.
  3. Click "+ New Token".
  4. Give it a name (e.g., ADO Tools), set an expiration date, and select the following scopes:
    • Work Items - Read
    • Build - Read
    • Code - Read
  5. Click Create.
  6. Copy the token immediately - you will not be able to see it again. Paste it into the PAT field in ADO Tools Settings.
Step-by-step guide to creating a Personal Access Token in Azure DevOps How to navigate to the PAT page and create a new token in Azure DevOps. (Click to enlarge)
Keep your PAT safe Treat your PAT like a password. Do not share it or commit it to source control. If compromised, revoke it immediately from the same page and create a new one.

Setting Up Download Folders

You need to configure two download folders:

FolderUsed for
Work Items Download FolderAttachments downloaded from work items (one subfolder per work item).
Software Download FolderBuild artifacts (ZIPs and extracted setup files) from Software Downloads.

Click the folder icon next to each path to open a folder picker, or type the path directly.

Settings tab Download Paths card The Download Paths card with both folder fields and Browse buttons.

Work Items

The Work Items tab is your primary workspace for browsing, searching, and downloading Azure DevOps work items and their attachments.

Full Work Items tab The full Work Items tab showing the Connection bar, Query panel, toolbar, data grid, and status bar.

Connecting to a Project

If your settings are already configured, ADO Tools automatically connects when you open the app and loads your query tree. You will see "Connected" next to the Connect button.

To connect manually or switch projects:

  1. Enter the Project name in the text box at the top (e.g., civil).
  2. Click the blue Connect button.
  3. The query tree will populate with your Favorites and All Queries.
Connection bar The Connection bar showing the Project field, Connect button, and connection status.

Running Queries

After connecting, the Query panel shows your Azure DevOps queries organized into two groups:

To run a query:

  1. Expand the query tree and click on a query to select it.
  2. Click the Read Items button (or double-click the query to collapse the tree first).
  3. The app fetches work items and displays them in the grid below.
Query panel with tree view The query tree with Favorites expanded and a query selected, with the Read Items button on the right.
Collapsing the Query Tree Double-click a query to collapse the tree into a compact label (e.g., "Active Bugs"). This gives you more screen space for the data grid. Click the label to expand the tree again.

Smart Caching

When you run a query, ADO Tools uses intelligent caching to speed things up:

The Data Grid

Work items are displayed in a full-featured data grid. The grid header shows a context badge indicating what data is currently displayed:

Badge ColourLabelMeaning
BlueQuery: query nameResults from an Azure DevOps query.
GreenSearch in "query name"Keyword search within the current query results.
PurpleBacklog Search: "search term"Semantic or keyword search across the full backlog index.
OrangeSimilar to: #IDResults from "Find Similar" - items similar to a specific work item.
Data grid header area The data grid header showing the context badge, item count, and filter/column picker buttons.

Customising Columns

The columns displayed in the grid are dynamic - they match the fields returned by your query. You can customise which columns are visible:

  1. Click the column picker button (grid icon) in the top-right corner of the grid header.
  2. A flyout opens with checkboxes for every available field. Check or uncheck fields to show or hide columns.
  3. Click Reset to Default to restore the original column layout.

Column widths are resizable - drag the column borders to adjust. Your column choices and widths are saved separately for query mode and search mode, and persist between sessions.

Column picker flyout The column picker flyout with checkboxes for available fields.

Filtering Rows

Click the filter button (funnel icon) in the grid header to open the filter flyout. You can filter by up to five fields simultaneously:

Each filter dropdown is populated with the actual values from your current data. A badge number appears on the filter button showing how many filters are active. Click Clear Filters to reset all filters at once.

Filter flyout The filter flyout showing dropdowns for Type, State, Area Path, Priority, and Assigned To.

Sorting

Click any column header to sort the grid by that column. Click again to toggle between ascending and descending order. A small arrow indicator appears on the sorted column.

Highlighting Recent Items

The Highlight control in the left toolbar lets you visually mark recently created items. Enter a number of days (e.g., 5) and any work item created within that many days from today will be highlighted in blue.

Highlighted rows The data grid with recently created rows highlighted in blue.

Downloading Attachments

To download attachments from one or more work items:

  1. Select one or more rows in the grid (hold Ctrl or Shift to multi-select).
  2. Click Download Selected in the toolbar. The button shows the selection count (e.g., "Download Selected (3)").
  3. The app creates a folder for each work item (named by its ID) inside your configured download folder.
  4. Attachments are downloaded into each folder, along with an HTML file linking back to the work item on Azure DevOps.
  5. When complete, a clickable folder link appears in the status bar to open the download location in Explorer.
Status bar after download The status bar after a download, showing a clickable folder link.
Tip If any individual attachment fails to download, the rest continue. The status bar shows how many failed (e.g., "Download Complete (1 attachment(s) failed)").

Download by Work Item ID

If you know the work item ID, you can download its attachments directly without loading a query:

  1. Enter the work item ID in the Work Item number box on the right side of the toolbar (e.g., 2011414).
  2. Click the download icon button next to it.
  3. The app fetches the work item from the API, downloads all attachments, and shows the folder link.
Note Selecting a row in the grid automatically populates the Work Item ID field, so you can easily switch between grid-based and ID-based downloads.

Opening Work Items in the Browser

Double-click any row in the data grid to open that work item in your default web browser on Azure DevOps.

ADO Tools provides two levels of search - searching within the current query results, and searching across your entire backlog using an AI-powered index. Both are accessed from the Work Items tab.

The Work Items tab has two sub-tabs at the top: Query and Search. Switch between them to access different search scopes.

Search Within Query Results

After running a query, a search box appears below the query tree on the Query sub-tab. This lets you search through the loaded results using keyword matching (BM25).

  1. Run a query to load work items.
  2. Type your search terms in the search box (e.g., crash report).
  3. Press Enter or click the search icon to execute.
  4. Results are ranked by relevance, with BM25 scores shown in the Title column.

Click the clear button next to the search box to return to the full query results.

Query search results The Query sub-tab with a search term entered and scored results in the grid.

Backlog Search

Switch to the Search sub-tab to search across your entire backlog index. This uses the semantic search index that you build from the Settings tab (see Building the Search Index).

  1. Click the Search sub-tab.
  2. Select a search mode from the dropdown (see Search Modes below).
  3. Type your search query and press Enter.
  4. Results appear in the grid with relevance scores.

Additional controls on the Search sub-tab:

ControlDescription
Exclude DoneCheckbox that filters out completed/closed/done items from results.
TopNumber of results to return (default: 30, max: 500).
ClearClears the search and returns to the previous query results.
UpdateFetches new/changed items from Azure DevOps and updates the search index incrementally.
Backlog search results The Search sub-tab with a search query entered and results displayed with relevance scores.

Search Modes

The backlog search supports three modes, selected from the dropdown on the left:

ModeHow it worksBest for
Hybrid (RRF)Runs both Semantic and Keyword searches in parallel, then combines the rankings using Reciprocal Rank Fusion. Items found by both methods get boosted.General use - the recommended default. Combines the strengths of both methods.
SemanticUses AI sentence embeddings to find items with similar meaning, even if they use different words.Natural language queries like "application crashes when opening large DGN files".
Keyword (BM25)Traditional keyword matching with TF-IDF weighting. Finds items containing the exact words you type.Searching for specific terms or codes like "cant points" or "PGL elevation".
Tip Hybrid mode is usually the best choice. Semantic search understands meaning (e.g., "crash" matches "application error"), while BM25 catches exact technical terms. Hybrid combines both.

Find Similar

The Find Similar feature finds work items that are similar to a specific item - useful for finding duplicates or related issues.

  1. Enter a work item ID in the Work Item field (or select a row in the grid - the ID is filled automatically).
  2. Click Find Similar (Cache).
  3. The app searches the backlog index for similar items using both semantic and keyword matching.
  4. The source item appears at the top of the results tagged with [Source] and highlighted in orange.
  5. Similar items are listed below with relevance scores (e.g., "[82%]").
Find Similar results Find Similar results with the source item highlighted in orange at the top.
Offline Support Find Similar works even when you are not connected to Azure DevOps, as long as the work item exists in your local search index.

Suggestions and History

Both search boxes (Query search and Backlog search) provide intelligent auto-suggestions:

Click into an empty search box to see your recent history. Start typing to see both history matches and vocabulary suggestions.

Search suggestions The search box with the suggestion dropdown showing recent history and vocabulary completions.

Building the Search Index

Before you can use Backlog Search or Find Similar, you need to build a search index. This is a one-time setup (with incremental updates afterward).

From the Settings tab (recommended for first-time setup):

  1. Go to the Settings tab.
  2. In the Search Index card, set the Iteration Path to limit which work items are indexed (e.g., Civil\OpenCivil Designer\Backlog). Leave empty to index everything.
  3. Set the Index Cutoff Date - only items created after this date will be indexed.
  4. Click Update Index. Progress is shown as items are fetched and embedded.
  5. Once complete, the status shows the number of items indexed.
Search Index card The Search Index card with Iteration Path, Cutoff Date, cache status, and the Update Index / Force Rebuild buttons.

From the Work Items tab (quick update):

Click the Update button on the Search sub-tab to incrementally update the index without leaving the Work Items tab.

Force Rebuild:

The Force Rebuild button on the Settings tab deletes the entire cache and re-indexes everything from scratch. This requires a two-click confirmation (the button changes to "Confirm Rebuild?" for 5 seconds - click again to confirm, or wait for it to cancel).

Force Rebuild Force Rebuild can take a long time if your backlog has thousands of items, as every item needs to be fetched and embedded. Use Update Index for normal maintenance - it only processes new or changed items.

Software Downloads

The Software Downloads tab lets you browse, download, and install software builds from Azure DevOps pipelines.

Full Software Downloads tab The Software Downloads tab with Product Selection, Build List, Install Options, and Activity Log.

Product Selection

The Product Selection card at the top-left lets you choose which software product to work with. Each product is mapped to an Azure DevOps pipeline definition ID and project.

Several products come pre-configured. When you select a product from the dropdown, the Def. ID and Project fields update automatically.

Managing Product Definitions:

Product Selection card The Product Selection card with product dropdown, Def. ID, Project, and Add/Remove buttons.

Loading Builds

  1. Select a product from the dropdown.
  2. Set the build count (how many recent builds to fetch, default: 30).
  3. Click Load Builds.
  4. The build list populates with columns: Product, Version, Result, and Finish Time.

Versions from the latest major version are highlighted in a different colour to help you quickly identify the newest releases. Build results are colour-coded (green for succeeded, red for failed).

Filtering Builds:

Use the Filter builds search box above the build list to narrow down builds by version number or text.

Build list The Build List card with builds loaded, colour-coded results, and the filter box.

Run Update (Download, Extract, Install)

The Run Update button performs the complete update workflow:

  1. Download - Downloads build artifact ZIPs from Azure DevOps. Progress shows download speed and size.
  2. Extract - Extracts the ZIP contents to a subfolder.
  3. Uninstall - If a matching version is already installed, it is uninstalled first (detected automatically from the Windows Registry).
  4. Install - Runs the extracted setup executable in quiet mode.
Download progress The download progress panel showing size, speed, progress bar, and the Stop button.

Install Options:

OptionDescription
Download OnlyWhen toggled ON, only downloads and extracts artifacts - skips uninstall and install steps.
Clean UninstallWhen toggled ON, performs additional cleanup of leftover files and folders after the standard MSI uninstall.

Smart Download:

If an artifact ZIP already exists on disk, the app compares the local file size with the server size. If they match and the ZIP is valid, you are asked whether to re-download or reuse the existing file, saving time on large downloads.

Cancelling a Download:

Click the Stop button (appears during downloads) to cancel. The download stops gracefully after the current chunk completes.

Sleep Prevention During downloads and installations, ADO Tools prevents your computer from going to sleep, ensuring long downloads are not interrupted.

Download Only Mode

Toggle Download Only ON if you just want to download and extract the build without installing it. This is useful when you want to:

Viewing and Managing Installed Software

Click Installed Software (at the top-right of the Build List card) to open a dialog showing all Bentley software installed on your machine. The dialog shows:

Installed Bentley Software dialog The Installed Bentley Software dialog listing installed products with Uninstall options.

Activity Log

The Activity Log panel at the bottom-right records all operations with timestamped messages. Each log entry has a contextual icon (info, progress, success, error).

During downloads, progress messages update the last entry in-place rather than creating new lines, keeping the log clean and readable.

An installer info bar appears at the bottom whenever Windows Installer is running, showing elapsed time.

Click the trash icon to clear the log.

Activity Log panel The Activity Log panel showing timestamped log entries with contextual icons.

Settings

The Settings tab is organized into four cards across two columns. Your settings are saved automatically when you leave the Settings tab or close the application.

Full Settings tab The Settings tab showing Search Index, Connection, Download Paths, and About cards.

Azure DevOps Connection

The Connection card (top-right) contains:

FieldDescriptionExample
OrganisationYour Azure DevOps organisation name.myorg
Default ProjectThe default project used across all tabs.civil
Personal Access TokenYour PAT (stored securely in a password field).(hidden)

Click Validate Connection to test. The result appears as a colour-coded info bar:

Search Index

The Search Index card (top-left) configures and manages the AI search index:

Field/ButtonDescription
Iteration PathLimits indexing to a specific area/iteration path. Leave empty to index all work items in the project.
Index Cutoff DateOnly items created after this date are indexed. Helps avoid indexing very old, irrelevant items.
Update IndexIncrementally updates the index - fetches only new or changed items since the last build. Fast for routine updates.
Force RebuildDeletes the entire cache and re-indexes from scratch. Requires two-click confirmation.

Download Paths

The Download Paths card (full-width, bottom) has two folder settings:

PathUsed by
Work Items Download FolderWork Items tab - where attachment downloads are saved (one subfolder per work item ID).
Software Download FolderSoftware Downloads tab - where build artifacts are downloaded and extracted.

Each field has a Browse button that opens a folder picker dialog.

About

The About card shows the application name, version number, and author contact information.

Tips and Shortcuts

ActionHow
Open work item in browserDouble-click a row in the data grid.
Select multiple work itemsHold Ctrl and click rows, or Shift+click for a range.
Collapse the query treeDouble-click a query to collapse the tree into a compact label.
Expand the query treeClick the collapsed query label.
Run a searchType in the search box and press Enter.
View search historyClick into an empty search box to see recent searches.
Quickly find similar itemsSelect a row in the grid, then click Find Similar (Cache).
Resize columnsDrag the column borders in the data grid header.
Cancel a downloadClick the Stop button during a Software Downloads operation.
Open downloaded filesClick the folder link in the status bar after a download completes.

Troubleshooting

I cannot connect - "Could not reach the server"

Authentication failed

Search is disabled / "No cache found"

Search results seem inaccurate

Setup file not found during software update

"No matching installed version found" during update

Download was cancelled or failed

Window size or columns are not being remembered


Back to Documentation Home

ADO Tools - Azure DevOps Productivity Suite
For questions or feedback, contact kivanc.karakas@bentley.com