Benchmarks for dotnet/runtime#127845 (for @EgorBo)

[EgorBot]

Processing benchmark request from PR dotnet/runtime#127845.

Targets: macos15_helix_arm64, ubuntu24_azure_turin
Commits: main;PR_127845

• macos15_helix_arm64: live logs
• ubuntu24_azure_turin: live logs

Results will be posted here once they are ready.

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M4, 1 CPU, 10 logical and 10 physical cores
.NET SDK 11.0.100-preview.5.26255.106
  [Host]     : .NET 10.0.7 (10.0.7, 10.0.726.21808), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Length	Mean	Error	Ratio
IntMax	PR #127845**	32	1.710 ns	0.0021 ns	1.00
IntMax	main	32	1.723 ns	0.0045 ns	1.01
IntMin	PR #127845	32	1.729 ns	0.0054 ns	1.00
IntMin	main	32	1.719 ns	0.0067 ns	0.99
LongMax	PR #127845	32	3.776 ns	0.0434 ns	1.00
LongMax	main	32	3.764 ns	0.0305 ns	1.00
ByteMax	PR #127845	32	5.792 ns	0.0293 ns	1.00
ByteMax	main	32	6.368 ns	0.0869 ns	1.10
IntMax	PR #127845**	256	15.171 ns	0.1469 ns	1.00
IntMax	main	256	14.980 ns	0.1110 ns	0.99
IntMin	PR #127845	256	15.000 ns	0.1148 ns	1.00
IntMin	main	256	15.027 ns	0.0935 ns	1.00
LongMax	PR #127845	256	68.322 ns	0.1770 ns	1.00
LongMax	main	256	68.875 ns	0.0203 ns	1.01
ByteMax	PR #127845	256	8.711 ns	0.0994 ns	1.00
ByteMax	main	256	8.432 ns	0.0946 ns	0.97
IntMax	PR #127845**	4096	421.305 ns	0.2964 ns	1.00
IntMax	main	4096	424.995 ns	0.1206 ns	1.01
IntMin	PR #127845	4096	421.351 ns	0.0715 ns	1.00
IntMin	main	4096	430.280 ns	8.5401 ns	1.02
LongMax	PR #127845	4096	1,791.177 ns	1.0406 ns	1.00
LongMax	main	4096	1,791.625 ns	1.6324 ns	1.00
ByteMax	PR #127845	4096	88.267 ns	0.4586 ns	1.00
ByteMax	main	4096	88.820 ns	0.1364 ns	1.01

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.5.26255.106
  [Host]     : .NET 10.0.7 (10.0.7, 10.0.726.21808), X64 RyuJIT x86-64-v4

Method	Toolchain	Length	Mean	Error	Ratio
IntMax	PR #127845**	32	40.592 ns	0.1233 ns	1.00
IntMax	main	32	15.468 ns	0.1396 ns	0.38
IntMin	PR #127845	32	22.408 ns	0.3248 ns	1.00
IntMin	main	32	4.492 ns	0.1109 ns	0.20
LongMax	PR #127845	32	20.337 ns	0.1314 ns	1.00
LongMax	main	32	14.491 ns	0.3155 ns	0.71
ByteMax	PR #127845	32	49.339 ns	0.6764 ns	1.00
ByteMax	main	32	15.892 ns	0.3396 ns	0.32
IntMax	PR #127845**	256	29.093 ns	0.5919 ns	1.00
IntMax	main	256	9.522 ns	0.1703 ns	0.33
IntMin	PR #127845	256	32.221 ns	0.4414 ns	1.00
IntMin	main	256	11.114 ns	0.2427 ns	0.34
LongMax	PR #127845	256	20.271 ns	0.3878 ns	1.00
LongMax	main	256	12.548 ns	0.2423 ns	0.62
ByteMax	PR #127845	256	146.696 ns	2.7367 ns	1.00
ByteMax	main	256	109.390 ns	0.3216 ns	0.75
IntMax	PR #127845**	4096	125.481 ns	0.7662 ns	1.00
IntMax	main	4096	83.813 ns	1.3628 ns	0.67
IntMin	PR #127845	4096	205.584 ns	1.2895 ns	1.00
IntMin	main	4096	87.283 ns	1.2396 ns	0.42
LongMax	PR #127845	4096	219.342 ns	0.9040 ns	1.00
LongMax	main	4096	201.264 ns	1.0074 ns	0.92
ByteMax	PR #127845	4096	198.206 ns	0.7340 ns	1.00
ByteMax	main	4096	38.623 ns	0.5462 ns	0.19

Full logs

[EgorBo]

smells like inliner issue 🤔

[EgorBo]

@EgorBot -aws_amd -profiler

using System;
using System.Linq;
using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;

BenchmarkSwitcher.FromAssembly(typeof(Bench).Assembly).Run(args);

public class Bench
{
    private int[] _ints = default!;
    private long[] _longs = default!;
    private byte[] _bytes = default!;

    [Params(32)]
    public int Length { get; set; }

    [GlobalSetup]
    public void Setup()
    {
        var rng = new Random(42);
        _ints = new int[Length];
        _longs = new long[Length];
        _bytes = new byte[Length];
        for (int i = 0; i < Length; i++)
        {
            _ints[i] = rng.Next();
            _longs[i] = ((long)rng.Next() << 32) | (uint)rng.Next();
            _bytes[i] = (byte)rng.Next(256);
        }
    }

    [Benchmark] public int IntMax() => _ints.Max();
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• ubuntu24_aws_genoa: live logs

[EgorBot]

Results for ubuntu24_aws_genoa

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 9R14 2.60GHz, 1 CPU, 8 logical and 8 physical cores
.NET SDK 11.0.100-preview.5.26255.106
  [Host]     : .NET 10.0.7 (10.0.7, 10.0.726.21808), X64 RyuJIT x86-64-v4

Method	Toolchain	Length	Mean	Error	Ratio
IntMax	PR #127845	32	37.619 ns	0.0935 ns	1.00
IntMax	main	32	9.959 ns	0.0327 ns	0.26

Profiling artifacts

Bench.IntMax:

	main	PR_127845
flamegraph	link	link
functions	link	link
asm	link	link
stats	link	link
speedscope	link	link

Full logs

[EgorBo]

@EgorBot -arm -intel -amd

using System;
using System.Linq;
using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;

BenchmarkSwitcher.FromAssembly(typeof(Bench).Assembly).Run(args);

public class Bench
{
    private int[] _ints = default!;
    private long[] _longs = default!;
    private byte[] _bytes = default!;

    [Params(32, 256, 4096)]
    public int Length { get; set; }

    [GlobalSetup]
    public void Setup()
    {
        var rng = new Random(42);
        _ints = new int[Length];
        _longs = new long[Length];
        _bytes = new byte[Length];
        for (int i = 0; i < Length; i++)
        {
            _ints[i] = rng.Next();
            _longs[i] = ((long)rng.Next() << 32) | (uint)rng.Next();
            _bytes[i] = (byte)rng.Next(256);
        }
    }

    [Benchmark] public int IntMax() => _ints.Max();
    [Benchmark] public int IntMin() => _ints.Min();
    [Benchmark] public long LongMax() => _longs.Max();
    [Benchmark] public byte ByteMax() => _bytes.Max();
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• macos15_helix_arm64: live logs
• ubuntu24_azure_emeraldrapids: live logs
• ubuntu24_azure_turin: live logs

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.7.5 (24G624) [Darwin 24.6.0]
Apple M4, 1 CPU, 10 logical and 10 physical cores
.NET SDK 11.0.100-preview.5.26255.106
  [Host]     : .NET 10.0.7 (10.0.7, 10.0.726.21808), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Length	Mean	Error	Ratio
IntMax	PR #127845**	32	1.700 ns	0.0012 ns	1.00
IntMax	main	32	1.703 ns	0.0009 ns	1.00
IntMin	PR #127845	32	1.703 ns	0.0014 ns	1.00
IntMin	main	32	1.706 ns	0.0009 ns	1.00
LongMax	PR #127845	32	3.813 ns	0.0634 ns	1.00
LongMax	main	32	3.774 ns	0.0543 ns	0.99
ByteMax	PR #127845	32	5.088 ns	0.1221 ns	1.00
ByteMax	main	32	5.882 ns	0.0953 ns	1.16
IntMax	PR #127845**	256	15.145 ns	0.0924 ns	1.00
IntMax	main	256	15.235 ns	0.1002 ns	1.01
IntMin	PR #127845	256	15.520 ns	0.1023 ns	1.00
IntMin	main	256	15.526 ns	0.0512 ns	1.00
LongMax	PR #127845	256	69.897 ns	0.4484 ns	1.00
LongMax	main	256	69.214 ns	0.3607 ns	0.99
ByteMax	PR #127845	256	8.846 ns	0.0679 ns	1.00
ByteMax	main	256	8.623 ns	0.0664 ns	0.97
IntMax	PR #127845**	4096	429.324 ns	1.9677 ns	1.00
IntMax	main	4096	427.093 ns	1.7410 ns	0.99
IntMin	PR #127845	4096	428.353 ns	2.2754 ns	1.00
IntMin	main	4096	426.781 ns	2.0455 ns	1.00
LongMax	PR #127845	4096	1,790.833 ns	0.4555 ns	1.00
LongMax	main	4096	1,790.754 ns	0.6188 ns	1.00
ByteMax	PR #127845	4096	92.079 ns	0.6147 ns	1.00
ByteMax	main	4096	91.481 ns	0.4865 ns	0.99

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.5.26255.106
  [Host]     : .NET 10.0.7 (10.0.7, 10.0.726.21808), X64 RyuJIT x86-64-v4

Method	Toolchain	Length	Mean	Error	Ratio
IntMax	PR #127845**	32	4.650 ns	0.1142 ns	1.00
IntMax	main	32	29.261 ns	0.3828 ns	6.30
IntMin	PR #127845	32	28.918 ns	0.2422 ns	1.00
IntMin	main	32	5.869 ns	0.1054 ns	0.20
LongMax	PR #127845	32	4.022 ns	0.0539 ns	1.00
LongMax	main	32	3.218 ns	0.0544 ns	0.80
ByteMax	PR #127845	32	9.299 ns	0.2093 ns	1.00
ByteMax	main	32	18.009 ns	0.2654 ns	1.94
IntMax	PR #127845**	256	9.562 ns	0.0840 ns	1.00
IntMax	main	256	9.813 ns	0.1572 ns	1.03
IntMin	PR #127845	256	9.645 ns	0.1521 ns	1.00
IntMin	main	256	18.145 ns	0.1561 ns	1.88
LongMax	PR #127845	256	19.582 ns	0.0285 ns	1.00
LongMax	main	256	14.080 ns	0.3017 ns	0.72
ByteMax	PR #127845	256	18.347 ns	0.1401 ns	1.00
ByteMax	main	256	19.270 ns	0.1280 ns	1.05
IntMax	PR #127845**	4096	117.397 ns	0.4206 ns	1.00
IntMax	main	4096	98.559 ns	0.3363 ns	0.84
IntMin	PR #127845	4096	104.314 ns	0.4827 ns	1.00
IntMin	main	4096	99.966 ns	0.6230 ns	0.96
LongMax	PR #127845	4096	216.841 ns	0.7758 ns	1.00
LongMax	main	4096	208.981 ns	0.6728 ns	0.96
ByteMax	PR #127845	4096	41.092 ns	0.1926 ns	1.00
ByteMax	main	4096	75.082 ns	0.7277 ns	1.83

Full logs

[EgorBot]

Results for ubuntu24_azure_emeraldrapids

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
INTEL XEON PLATINUM 8573C 2.28GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.5.26255.106
  [Host]     : .NET 10.0.7 (10.0.7, 10.0.726.21808), X64 RyuJIT x86-64-v4

Method	Toolchain	Length	Mean	Error	Ratio
IntMax	PR #127845**	32	41.54 ns	0.602 ns	1.00
IntMax	main	32	41.26 ns	0.253 ns	0.99
IntMin	PR #127845	32	45.90 ns	0.388 ns	1.00
IntMin	main	32	45.76 ns	0.217 ns	1.00
LongMax	PR #127845	32	22.88 ns	0.163 ns	1.00
LongMax	main	32	23.06 ns	0.210 ns	1.01
ByteMax	PR #127845	32	16.51 ns	0.243 ns	1.00
ByteMax	main	32	25.85 ns	0.244 ns	1.57
IntMax	PR #127845**	256	49.27 ns	0.272 ns	1.00
IntMax	main	256	48.97 ns	0.700 ns	0.99
IntMin	PR #127845	256	49.17 ns	0.422 ns	1.00
IntMin	main	256	49.05 ns	0.884 ns	1.00
LongMax	PR #127845	256	28.68 ns	0.392 ns	1.00
LongMax	main	256	25.01 ns	0.386 ns	0.87
ByteMax	PR #127845	256	191.30 ns	3.205 ns	1.00
ByteMax	main	256	173.11 ns	3.377 ns	0.91
IntMax	PR #127845**	4096	125.44 ns	2.553 ns	1.00
IntMax	main	4096	130.26 ns	2.575 ns	1.04
IntMin	PR #127845	4096	130.98 ns	2.638 ns	1.00
IntMin	main	4096	130.47 ns	2.530 ns	1.00
LongMax	PR #127845	4096	421.84 ns	6.255 ns	1.00
LongMax	main	4096	429.12 ns	4.850 ns	1.02
ByteMax	PR #127845	4096	204.23 ns	2.727 ns	1.00
ByteMax	main	4096	201.18 ns	3.645 ns	0.99

Full logs