Overview of Qualcomm® AI Hub Workbench

• Getting started
  • Installation
  • Quick example (PyTorch)
• How it works
• How it works: inference jobs
  • What does a Qualcomm® AI Hub Workbench inference job do?

Examples

• Compiling Models
  • Compiling PyTorch to TensorFlow Lite
  • Compiling PyTorch model to a QNN DLC
  • Compiling PyTorch model to a QNN Context Binary
  • Compiling to a Precompiled QNN ONNX
  • Compiling PyTorch model for the ONNX Runtime
  • ONNX provenance and Workbench compilation
  • Compiling ONNX models to TensorFlow Lite or QNN
  • Compiling models quantized with AIMET to TensorFlow Lite or QNN
  • Compiling and Linking Models into weight-shared QNN Context Binary
• Running Inference & Profiling
  • Accuracy Questions
  • Latency Questions
  • submit_inference_job
  • Running inference on a previously compiled model
  • Running inference on a PyTorch model
  • Running inference on a TorchScript model
  • Running Inference with a TensorFlow Lite model
  • Running Inference with QNN DLC and Context Binaries
  • Running inference on an ONNX model
  • Running inference an ONNX model on a device that does not support floating point
  • Running inference on multiple devices
  • Verify model accuracy on-device using an inference job
  • Running inference using a previously uploaded dataset and model
  • Uploading a model for inference
  • Running inference on a previously uploaded model
• Quantization
  • Overview
  • Preparing the source model
  • Quantizing an ONNX model
  • Compiling a quantized model
  • Quantization options
  • Benchmarking quantized model performance
• Linking
  • Variable input size example
• Devices
  • Device Selection
  • Device Types
  • Device Filtering
• Working with Jobs
  • Querying Jobs
  • Profiling Results
  • Model IO Specs
  • Downloading Job Artifacts
  • Sharing Jobs
• Working with Frameworks
  • Querying Frameworks
  • Submitting Jobs with Framework Versions
  • Version Selection
• Command Line Interface
  • Examples
• Deployment
  • Create Deployable ONNX models
  • Qualcomm® AI Hub Apps

API Documentation

• API documentation
  • Core API
  • Managed objects
  • Exceptions
  • Common Options
  • Compile Options
  • Quantize Options
  • Link Options
  • Inference Options
  • ONNX Runtime Options
  • ONNX Runtime QNN Execution Provider options
  • ONNX Runtime DirectML Execution Provider options
  • TensorFlow Lite Options
  • TensorFlow Lite Delegate Options for Qualcomm® AI Engine Direct
  • TensorFlow Lite Delegate Options for GPUv2
  • Qualcomm® AI Engine Direct Options

FAQ

• Frequently Asked Questions
  • General
  • Model Formats
  • Passing Options
  • Common job failures and known issues
  • Deployment

Release Notes

• Release Notes
  • Released September 28, 2026
  • Released September 14, 2026
  • Released August 31, 2026
  • Released August 17, 2026
  • Released August 3, 2026
  • Released July 20, 2026
  • Released July 6, 2026
  • Released June 22, 2026
  • Released June 9, 2026
  • Released May 28th, 2026
  • Released May 11, 2026
  • Released April 27, 2026
  • Released April 14, 2026
  • Released March 30, 2026
  • Released March 2, 2026
  • Released February 17, 2026
  • Released February 2, 2026
  • Released January 26, 2026
  • Released January 6, 2026
  • Released December 8, 2025
  • Released November 19, 2025
  • Released November 4, 2025
  • Released October 27, 2025
  • Released October 22, 2025
  • Released October 6, 2025
  • Released September 29, 2025
  • Released September 22, 2025
  • Released September 8, 2025
  • Released September 2, 2025
  • Released August 22, 2025
  • Released August 11, 2025
  • Released July 28, 2025
  • Released July 14, 2025
  • Released June 30, 2025
  • Released June 16, 2025
  • Released June 2, 2025
  • Released May 14, 2025
  • Released May 5, 2025
  • Released April 22, 2025
  • Released April 8, 2025
  • Released March 25, 2025
  • Released March 10, 2025
  • Released February 24, 2025
  • Released Febuary 10, 2025
  • Released January 22, 2025
  • Released January 6, 2025
  • Released December 13, 2024
  • Released November 25, 2024
  • Released November 11, 2024
  • Released October 28, 2024
  • Released October 14, 2024
  • Released October 7, 2024
  • Released September 23, 2024
  • Released September 11, 2024
  • Released August 26, 2024
  • Released August 12, 2024
  • Released July 29, 2024
  • Released July 15, 2024
  • Released July 1, 2024
  • Released June 17, 2024
  • Released June 4, 2024
  • Released May 17, 2024
  • Released May 6, 2024
  • Released April 22, 2024
  • Released April 8, 2024
  • Released March 25, 2024
  • Released March 11, 2024
  • Released February 28, 2024