-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Don't run benchmarks from fork #485
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
christiangnrd
force-pushed
the
nobench
branch
from
November 30, 2024 22:44
77a4511
to
5cf14e7
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Metal Benchmarks
Benchmark suite | Current: 5cf14e7 | Previous: 3ec440f | Ratio |
---|---|---|---|
private array/construct |
25833.333333333332 ns |
25494 ns |
1.01 |
private array/broadcast |
461167 ns |
464917 ns |
0.99 |
private array/random/randn/Float32 |
733645.5 ns |
913875 ns |
0.80 |
private array/random/randn!/Float32 |
623459 ns |
595833.5 ns |
1.05 |
private array/random/rand!/Int64 |
560833 ns |
551583 ns |
1.02 |
private array/random/rand!/Float32 |
592833 ns |
558666.5 ns |
1.06 |
private array/random/rand/Int64 |
758875.5 ns |
899583 ns |
0.84 |
private array/random/rand/Float32 |
557771 ns |
817333 ns |
0.68 |
private array/copyto!/gpu_to_gpu |
689541 ns |
561250 ns |
1.23 |
private array/copyto!/cpu_to_gpu |
830292 ns |
702791.5 ns |
1.18 |
private array/copyto!/gpu_to_cpu |
644624.5 ns |
621542 ns |
1.04 |
private array/accumulate/1d |
1332709 ns |
1408542 ns |
0.95 |
private array/accumulate/2d |
1375729.5 ns |
1502750 ns |
0.92 |
private array/iteration/findall/int |
2053687 ns |
2276334 ns |
0.90 |
private array/iteration/findall/bool |
1817187.5 ns |
1993104 ns |
0.91 |
private array/iteration/findfirst/int |
1692083 ns |
1808458 ns |
0.94 |
private array/iteration/findfirst/bool |
1656667 ns |
1712312.5 ns |
0.97 |
private array/iteration/scalar |
3920541 ns |
2520292 ns |
1.56 |
private array/iteration/logical |
3170896 ns |
3486084 ns |
0.91 |
private array/iteration/findmin/1d |
1753500 ns |
1882417 ns |
0.93 |
private array/iteration/findmin/2d |
1337125 ns |
1417750 ns |
0.94 |
private array/reductions/reduce/1d |
1029354.5 ns |
964500 ns |
1.07 |
private array/reductions/reduce/2d |
655167 ns |
697917 ns |
0.94 |
private array/reductions/mapreduce/1d |
1050375 ns |
997020.5 ns |
1.05 |
private array/reductions/mapreduce/2d |
650333 ns |
693750 ns |
0.94 |
private array/permutedims/4d |
3077959 ns |
3093667 ns |
0.99 |
private array/permutedims/2d |
994979.5 ns |
1068458 ns |
0.93 |
private array/permutedims/3d |
1571208 ns |
1842166 ns |
0.85 |
private array/copy |
599000 ns |
836458 ns |
0.72 |
latency/precompile |
5183702042 ns |
5253931625 ns |
0.99 |
latency/ttfp |
6490872437 ns |
6649813771 ns |
0.98 |
latency/import |
1128833771 ns |
1145857916 ns |
0.99 |
integration/metaldevrt |
697958 ns |
750770.5 ns |
0.93 |
integration/byval/slices=1 |
1605646 ns |
1662375 ns |
0.97 |
integration/byval/slices=3 |
8575417 ns |
20314209 ns |
0.42 |
integration/byval/reference |
1546937.5 ns |
1666875 ns |
0.93 |
integration/byval/slices=2 |
2749000 ns |
2757583.5 ns |
1.00 |
kernel/indexing |
456333 ns |
460145.5 ns |
0.99 |
kernel/indexing_checked |
451083 ns |
463042 ns |
0.97 |
kernel/launch |
8375 ns |
35656.25 ns |
0.23 |
metal/synchronization/stream |
14833 ns |
14917 ns |
0.99 |
metal/synchronization/context |
15583 ns |
15375 ns |
1.01 |
shared array/construct |
26427.083333333336 ns |
25805.5 ns |
1.02 |
shared array/broadcast |
464875 ns |
461791 ns |
1.01 |
shared array/random/randn/Float32 |
837770.5 ns |
919417 ns |
0.91 |
shared array/random/randn!/Float32 |
648937.5 ns |
600250 ns |
1.08 |
shared array/random/rand!/Int64 |
549583 ns |
548958 ns |
1.00 |
shared array/random/rand!/Float32 |
595041 ns |
561916 ns |
1.06 |
shared array/random/rand/Int64 |
792292 ns |
876166 ns |
0.90 |
shared array/random/rand/Float32 |
575375 ns |
824312.5 ns |
0.70 |
shared array/copyto!/gpu_to_gpu |
86792 ns |
80334 ns |
1.08 |
shared array/copyto!/cpu_to_gpu |
90709 ns |
81084 ns |
1.12 |
shared array/copyto!/gpu_to_cpu |
82416 ns |
79125 ns |
1.04 |
shared array/accumulate/1d |
1358541 ns |
1417750 ns |
0.96 |
shared array/accumulate/2d |
1390625 ns |
1499520.5 ns |
0.93 |
shared array/iteration/findall/int |
1806021 ns |
2022521 ns |
0.89 |
shared array/iteration/findall/bool |
1595229 ns |
1713854.5 ns |
0.93 |
shared array/iteration/findfirst/int |
1389854.5 ns |
1489417 ns |
0.93 |
shared array/iteration/findfirst/bool |
1356271 ns |
1415500 ns |
0.96 |
shared array/iteration/scalar |
160792 ns |
159208 ns |
1.01 |
shared array/iteration/logical |
3000500 ns |
3167979 ns |
0.95 |
shared array/iteration/findmin/1d |
1458250 ns |
1558916.5 ns |
0.94 |
shared array/iteration/findmin/2d |
1352771 ns |
1427437.5 ns |
0.95 |
shared array/reductions/reduce/1d |
705542 ns |
697458 ns |
1.01 |
shared array/reductions/reduce/2d |
652625 ns |
697125 ns |
0.94 |
shared array/reductions/mapreduce/1d |
745709 ns |
707292 ns |
1.05 |
shared array/reductions/mapreduce/2d |
656583 ns |
702291 ns |
0.93 |
shared array/permutedims/4d |
2713208 ns |
3157708 ns |
0.86 |
shared array/permutedims/2d |
1006916.5 ns |
1067771 ns |
0.94 |
shared array/permutedims/3d |
1567583.5 ns |
1874583.5 ns |
0.84 |
shared array/copy |
250104 ns |
206458 ns |
1.21 |
This comment was automatically generated by workflow using github-action-benchmark.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Test from non-fork