[tests] Update max simulator OS version. by rolfbjarne · Pull Request #24867 · dotnet/macios

rolfbjarne · 2026-03-10T12:37:37Z

This fixes the following problem:

We default the max simulator version to the SDK version of an OS (currently 26.2)
However, iOS/tvOS 26.3 exists, and that's the simulator 'xcodebuild -downloadPlatform' installs with Xcode 26.3.
The max simulator version is what we use in xharness to decide which simulator to run tests in.
The result is that xharness will try to use/create a simulator for iOS 26.2, but that might not be possible (unless said simulator was already installed from before the current build), because it wasn't provisioned.

This fixes the following problem: * We default the max simulator version to the SDK version of an OS (currently 26.2) * However, iOS/tvOS 26.3 exists, and that's the simulator 'xcodebuild -downloadPlatform' installs with Xcode 26.3. * The max simulator version is what we use in xharness to decide which simulator to run tests in. * The result is that xharness will try to use/create a simulator for iOS 26.2, but that might not be possible (unless said simulator was already installed from before the current build), because it wasn't provisioned.

Copilot

Pull request overview

Updates simulator test OS selection so xharness uses the newest simulator runtime available with the selected Xcode (even when the SDK version hasn’t changed), avoiding attempts to create/run simulators for unprovisioned OS versions.

Changes:

Introduce logic in Make.config to set MAX_IOS_SIMULATOR_VERSION / MAX_TVOS_SIMULATOR_VERSION based on XCODE_VERSION (special-casing Xcode 26.3 -> simulator 26.3).
Add make-time guardrails ($(error ...)) to force revisiting this mapping when Xcode/SDK version relationships change.

You can also share your feedback on Copilot code review. Take the survey.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

… iOS/tvOS 26.3 Replace xamvideotest.mp4 with a freshly-generated, well-formed H.264 Baseline video. The old video (created in 2015 by Mainconcept encoder) had non-standard dimensions (438x434, not multiples of 16) and produced codecBadDataErr (-8969) on iOS/tvOS 26.4 simulators where the decoder is stricter. The new video uses standard dimensions (320x240), H.264 Constrained Baseline profile, and is generated with ffmpeg to ensure well-formed NAL units. Also add WaitForAsynchronousFrames() after FinishDelayedFrames() in all async decode tests. FinishDelayedFrames() directs the session to emit all delayed frames, but WaitForAsynchronousFrames() is needed to block until all async callbacks have completed before checking assertions. Fixes #24844 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

vs-mobiletools-engineering-service2 · 2026-03-11T12:20:30Z

✅ [CI Build #c663b9f] Build passed (Build packages) ✅

Pipeline on Agent
Hash: c663b9f6d0d7d134e903870ff857e0cad4d3277d [PR build]

vs-mobiletools-engineering-service2 · 2026-03-11T14:36:43Z

✅ [PR Build #1fbf9e6] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: 1fbf9e64ee7390cc960d39b0daf3a3ea3d54b7ca [PR build]

vs-mobiletools-engineering-service2 · 2026-03-11T15:26:49Z

✅ API diff for current PR / commit

NET (empty diffs)

iOS: vsdrops gist ( No breaking changes )
tvOS: vsdrops gist ( No breaking changes )
MacCatalyst: vsdrops gist ( No breaking changes )
macOS: vsdrops gist ( No breaking changes )

✅ API diff vs stable

NET (empty diffs)

iOS: vsdrops gist ( No breaking changes )
tvOS: vsdrops gist ( No breaking changes )
MacCatalyst: vsdrops gist ( No breaking changes )
macOS: vsdrops gist ( No breaking changes )

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: 1fbf9e64ee7390cc960d39b0daf3a3ea3d54b7ca [PR build]

vs-mobiletools-engineering-service2 · 2026-03-11T15:30:19Z

✅ [CI Build #1fbf9e6] Build passed (Build macOS tests) ✅

Pipeline on Agent
Hash: 1fbf9e64ee7390cc960d39b0daf3a3ea3d54b7ca [PR build]

vs-mobiletools-engineering-service2 · 2026-03-12T08:53:15Z

🚀 [CI Build #1fbf9e6] Test results 🚀

Test results

✅ All tests passed on VSTS: test results.

🎉 All 156 tests passed 🎉

Tests counts

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 5 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 6 tests passed. Html Report (VSDrops) Download
✅ linker: All 44 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 11 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 15 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ monotouch (macOS): All 12 tests passed. [attempt 2] Html Report (VSDrops) Download
✅ monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ windows: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

✅ Tests on macOS Monterey (12): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Ventura (13): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sonoma (14): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sequoia (15): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Tahoe (26): All 5 tests passed. [attempt 2] Html Report (VSDrops) Download

Pipeline on Agent
Hash: 1fbf9e64ee7390cc960d39b0daf3a3ea3d54b7ca [PR build]

rolfbjarne requested a review from Copilot March 10, 2026 12:37

Copilot started reviewing on behalf of rolfbjarne March 10, 2026 12:38 View session

Copilot AI reviewed Mar 10, 2026

View reviewed changes

Auto-format source code

d0fd258

dalexsoto approved these changes Mar 10, 2026

View reviewed changes