The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.

NAME

Bencher::Scenario::ArrayData::Word::ID::KBBI::pick_items - Benchmark picking words

VERSION

This document describes version 0.001 of Bencher::Scenario::ArrayData::Word::ID::KBBI::pick_items (from Perl distribution Bencher-Scenarios-ArrayData), released on 2022-02-05.

SYNOPSIS

To run benchmark with default option:

 % bencher -m ArrayData::Word::ID::KBBI::pick_items

To run module startup overhead benchmark:

 % bencher --module-startup -m ArrayData::Word::ID::KBBI::pick_items

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

ArrayData::Word::ID::KBBI 0.004

WordList::ID::KBBI 0.050

BENCHMARK PARTICIPANTS

  • ArrayData::Word::ID::KBBI-pick_items-1 (perl_code)

    Code template:

     my $ary = ArrayData::Word::ID::KBBI->new;                                                                         $ary->pick_items(n=>1)  for 1..20; my ($w) = $ary->pick_items(n=>1); $w
  • WordList::ID::KBBI-pick-1 (perl_code)

    Code template:

     my $wl  = WordList::ID::KBBI->new;        Role::Tiny->apply_roles_to_object($wl, "WordListRole::RandomSeekPick"); $wl ->pick              for 1..20; my ($w) = $wl->pick; $w
  • ArrayData::Word::ID::KBBI-pick_items-10 (perl_code)

    Code template:

     my $ary = ArrayData::Word::ID::KBBI->new;                                                                         $ary->pick_items(n=>10) for 1..20; my @w = $ary->pick_items(n=>10); \@w
  • WordList::ID::KBBI-pick-10 (perl_code)

    Code template:

     my $wl  = WordList::ID::KBBI->new;        Role::Tiny->apply_roles_to_object($wl, "WordListRole::RandomSeekPick"); $wl ->pick      (10)    for 1..20; my @w = $wl->pick(10); \@w

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.34.0, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-91-generic.

Benchmark with bencher -m ArrayData::Word::ID::KBBI::pick_items --multimodver Array::Set:

 #table1#
 {dataset=>undef}
 +-----------------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
 | participant                             | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors   | samples |
 +-----------------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
 | WordList::ID::KBBI-pick-10              |        30 |   30      |                 0.00% |             54560.69% |   0.00051 |      20 |
 | WordList::ID::KBBI-pick-1               |       700 |    2      |              2081.05% |              2406.16% | 7.5e-05   |      69 |
 | ArrayData::Word::ID::KBBI-pick_items-10 |     16600 |    0.0601 |             54523.94% |                 0.07% | 2.5e-08   |      23 |
 | ArrayData::Word::ID::KBBI-pick_items-1  |     17000 |    0.06   |             54560.69% |                 0.00% | 1.1e-07   |      20 |
 +-----------------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+

Formatted as Benchmark.pm result:

                                              Rate  WordList::ID::KBBI-pick-10  WordList::ID::KBBI-pick-1  ArrayData::Word::ID::KBBI-pick_items-10  ArrayData::Word::ID::KBBI-pick_items-1 
  WordList::ID::KBBI-pick-10                  30/s                          --                       -93%                                     -99%                                    -99% 
  WordList::ID::KBBI-pick-1                  700/s                       1400%                         --                                     -96%                                    -97% 
  ArrayData::Word::ID::KBBI-pick_items-10  16600/s                      49816%                      3227%                                       --                                      0% 
  ArrayData::Word::ID::KBBI-pick_items-1   17000/s                      49900%                      3233%                                       0%                                      -- 
 
 Legends:
   ArrayData::Word::ID::KBBI-pick_items-1: participant=ArrayData::Word::ID::KBBI-pick_items-1
   ArrayData::Word::ID::KBBI-pick_items-10: participant=ArrayData::Word::ID::KBBI-pick_items-10
   WordList::ID::KBBI-pick-1: participant=WordList::ID::KBBI-pick-1
   WordList::ID::KBBI-pick-10: participant=WordList::ID::KBBI-pick-10

Benchmark module startup overhead (bencher -m ArrayData::Word::ID::KBBI::pick_items --module-startup):

 #table2#
 +---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
 | participant               | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
 +---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
 | ArrayData::Word::ID::KBBI |     14.3  |              8.37 |                 0.00% |               140.77% | 9.6e-06 |      20 |
 | WordList::ID::KBBI        |     12.2  |              6.27 |                16.67% |               106.38% | 4.2e-06 |      21 |
 | perl -e1 (baseline)       |      5.93 |              0    |               140.77% |                 0.00% | 2.7e-06 |      20 |
 +---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+

Formatted as Benchmark.pm result:

                          Rate  AWI:K  WI:K  perl -e1 (baseline) 
  AWI:K                 69.9/s     --  -14%                 -58% 
  WI:K                  82.0/s    17%    --                 -51% 
  perl -e1 (baseline)  168.6/s   141%  105%                   -- 
 
 Legends:
   AWI:K: mod_overhead_time=8.37 participant=ArrayData::Word::ID::KBBI
   WI:K: mod_overhead_time=6.27 participant=WordList::ID::KBBI
   perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

BENCHMARK NOTES

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-ArrayData.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-ArrayData.

SEE ALSO

AUTHOR

perlancar <perlancar@cpan.org>

CONTRIBUTING

To contribute, you can send patches by email/via RT, or send pull requests on GitHub.

Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:

 % prove -l

If you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla plugin and/or Pod::Weaver::Plugin. Any additional steps required beyond that are considered a bug and can be reported to me.

COPYRIGHT AND LICENSE

This software is copyright (c) 2022 by perlancar <perlancar@cpan.org>.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-ArrayData

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.