Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't run benchmarks from fork #485

Merged
merged 1 commit into from
Nov 30, 2024
Merged

Don't run benchmarks from fork #485

merged 1 commit into from
Nov 30, 2024

Conversation

christiangnrd
Copy link
Contributor

Test from non-fork

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Metal Benchmarks

Benchmark suite Current: 5cf14e7 Previous: 3ec440f Ratio
private array/construct 25833.333333333332 ns 25494 ns 1.01
private array/broadcast 461167 ns 464917 ns 0.99
private array/random/randn/Float32 733645.5 ns 913875 ns 0.80
private array/random/randn!/Float32 623459 ns 595833.5 ns 1.05
private array/random/rand!/Int64 560833 ns 551583 ns 1.02
private array/random/rand!/Float32 592833 ns 558666.5 ns 1.06
private array/random/rand/Int64 758875.5 ns 899583 ns 0.84
private array/random/rand/Float32 557771 ns 817333 ns 0.68
private array/copyto!/gpu_to_gpu 689541 ns 561250 ns 1.23
private array/copyto!/cpu_to_gpu 830292 ns 702791.5 ns 1.18
private array/copyto!/gpu_to_cpu 644624.5 ns 621542 ns 1.04
private array/accumulate/1d 1332709 ns 1408542 ns 0.95
private array/accumulate/2d 1375729.5 ns 1502750 ns 0.92
private array/iteration/findall/int 2053687 ns 2276334 ns 0.90
private array/iteration/findall/bool 1817187.5 ns 1993104 ns 0.91
private array/iteration/findfirst/int 1692083 ns 1808458 ns 0.94
private array/iteration/findfirst/bool 1656667 ns 1712312.5 ns 0.97
private array/iteration/scalar 3920541 ns 2520292 ns 1.56
private array/iteration/logical 3170896 ns 3486084 ns 0.91
private array/iteration/findmin/1d 1753500 ns 1882417 ns 0.93
private array/iteration/findmin/2d 1337125 ns 1417750 ns 0.94
private array/reductions/reduce/1d 1029354.5 ns 964500 ns 1.07
private array/reductions/reduce/2d 655167 ns 697917 ns 0.94
private array/reductions/mapreduce/1d 1050375 ns 997020.5 ns 1.05
private array/reductions/mapreduce/2d 650333 ns 693750 ns 0.94
private array/permutedims/4d 3077959 ns 3093667 ns 0.99
private array/permutedims/2d 994979.5 ns 1068458 ns 0.93
private array/permutedims/3d 1571208 ns 1842166 ns 0.85
private array/copy 599000 ns 836458 ns 0.72
latency/precompile 5183702042 ns 5253931625 ns 0.99
latency/ttfp 6490872437 ns 6649813771 ns 0.98
latency/import 1128833771 ns 1145857916 ns 0.99
integration/metaldevrt 697958 ns 750770.5 ns 0.93
integration/byval/slices=1 1605646 ns 1662375 ns 0.97
integration/byval/slices=3 8575417 ns 20314209 ns 0.42
integration/byval/reference 1546937.5 ns 1666875 ns 0.93
integration/byval/slices=2 2749000 ns 2757583.5 ns 1.00
kernel/indexing 456333 ns 460145.5 ns 0.99
kernel/indexing_checked 451083 ns 463042 ns 0.97
kernel/launch 8375 ns 35656.25 ns 0.23
metal/synchronization/stream 14833 ns 14917 ns 0.99
metal/synchronization/context 15583 ns 15375 ns 1.01
shared array/construct 26427.083333333336 ns 25805.5 ns 1.02
shared array/broadcast 464875 ns 461791 ns 1.01
shared array/random/randn/Float32 837770.5 ns 919417 ns 0.91
shared array/random/randn!/Float32 648937.5 ns 600250 ns 1.08
shared array/random/rand!/Int64 549583 ns 548958 ns 1.00
shared array/random/rand!/Float32 595041 ns 561916 ns 1.06
shared array/random/rand/Int64 792292 ns 876166 ns 0.90
shared array/random/rand/Float32 575375 ns 824312.5 ns 0.70
shared array/copyto!/gpu_to_gpu 86792 ns 80334 ns 1.08
shared array/copyto!/cpu_to_gpu 90709 ns 81084 ns 1.12
shared array/copyto!/gpu_to_cpu 82416 ns 79125 ns 1.04
shared array/accumulate/1d 1358541 ns 1417750 ns 0.96
shared array/accumulate/2d 1390625 ns 1499520.5 ns 0.93
shared array/iteration/findall/int 1806021 ns 2022521 ns 0.89
shared array/iteration/findall/bool 1595229 ns 1713854.5 ns 0.93
shared array/iteration/findfirst/int 1389854.5 ns 1489417 ns 0.93
shared array/iteration/findfirst/bool 1356271 ns 1415500 ns 0.96
shared array/iteration/scalar 160792 ns 159208 ns 1.01
shared array/iteration/logical 3000500 ns 3167979 ns 0.95
shared array/iteration/findmin/1d 1458250 ns 1558916.5 ns 0.94
shared array/iteration/findmin/2d 1352771 ns 1427437.5 ns 0.95
shared array/reductions/reduce/1d 705542 ns 697458 ns 1.01
shared array/reductions/reduce/2d 652625 ns 697125 ns 0.94
shared array/reductions/mapreduce/1d 745709 ns 707292 ns 1.05
shared array/reductions/mapreduce/2d 656583 ns 702291 ns 0.93
shared array/permutedims/4d 2713208 ns 3157708 ns 0.86
shared array/permutedims/2d 1006916.5 ns 1067771 ns 0.94
shared array/permutedims/3d 1567583.5 ns 1874583.5 ns 0.84
shared array/copy 250104 ns 206458 ns 1.21

This comment was automatically generated by workflow using github-action-benchmark.

@christiangnrd christiangnrd merged commit 9971d88 into main Nov 30, 2024
2 checks passed
@christiangnrd christiangnrd deleted the nobench branch November 30, 2024 23:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant