aboutsummaryrefslogtreecommitdiff
path: root/benchtests
AgeCommit message (Collapse)AuthorFilesLines
2021-10-08benchtests: Add medium cases and increase iters in bench-memset.cNoah Goldstein1-2/+2
No bug. This commit adds new medium size cases for lengths in [512, 1024). As well it increase the iters to INNER_LOOP_ITERS_LARGE for more reliable results. Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com>
2021-10-04benchtests: Building benchmarks as static executablesH.J. Lu2-7/+29
Building benchmarks as static executables: ========================================= To build benchmarks as static executables, on the build system, run: $ make STATIC-BENCHTESTS=yes bench-build You can copy benchmark executables to another machine and run them without copying the source nor build directories.
2021-09-24benchtests: Improve reliability of memcmp benchmarksNoah Goldstein1-11/+10
No bug. Remove reallocation of bufs between implementation tests. Move initialization outside of foreach implementation test loop. Increase iteration count. Generally before this commit was seeing a great deal of variability between runs. The goal of this commit is to make the results more reliable. Benchtests build and bench-memcmp succeeding. Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com>
2021-09-16benchtests: Fix validate_benchout.py exceptionsNaohiro Tamura3-3/+9
This patch fixed validate_benchout.py two exceptions, 1) AttributeError if benchout_strings.schema.json is specified, and 2) json.decoder.JSONDecodeError if benchout file is not JSON. $ ~/glibc/benchtests/scripts/validate_benchout.py bench-memset.out \ ~/glibc/benchtests/scripts/benchout_strings.schema.json Traceback (most recent call last): File "/home/naohirot/glibc/benchtests/scripts/validate_benchout.py", line 86, in <module> sys.exit(main(sys.argv[1:])) File "/home/naohirot/glibc/benchtests/scripts/validate_benchout.py", line 69, in main bench.parse_bench(args[0], args[1]) File "/home/naohirot/glibc/benchtests/scripts/import_bench.py", line 139, in parse_bench do_for_all_timings(bench, lambda b, f, v: File "/home/naohirot/glibc/benchtests/scripts/import_bench.py", line 107, in do_for_all_timings if 'timings' not in bench['functions'][func][k].keys(): AttributeError: 'str' object has no attribute 'keys' $ ~/glibc/benchtests/scripts/validate_benchout.py bench-math-inlines.out \ ~/glibc/benchtests/scripts/benchout_strings.schema.json Traceback (most recent call last): File "/home/naohirot/glibc/benchtests/scripts/validate_benchout.py", line 86, in <module> sys.exit(main(sys.argv[1:])) File "/home/naohirot/glibc/benchtests/scripts/validate_benchout.py", line 69, in main bench.parse_bench(args[0], args[1]) File "/home/naohirot/glibc/benchtests/scripts/import_bench.py", line 137, in parse_bench bench = json.load(benchfile) File "/usr/lib/python3.6/json/__init__.py", line 299, in load parse_constant=parse_constant, object_pairs_hook=object_pairs_hook, **kw) File "/usr/lib/python3.6/json/__init__.py", line 354, in loads return _default_decoder.decode(s) File "/usr/lib/python3.6/json/decoder.py", line 342, in decode raise JSONDecodeError("Extra data", s, end) json.decoder.JSONDecodeError: Extra data: line 1 column 17 (char 16) Reviewed-by: Siddhesh Poyarekar <siddhesh@sourceware.org>
2021-09-13benchtests: Remove redundant assert.hNaohiro Tamura2-2/+0
This patch removed redundant "#include <assert.h>" from bench-memset-large.c and bench-memset-walk.c. Reviewed-by: Siddhesh Poyarekar <siddhesh@sourceware.org>
2021-09-13benchtests: Enable scripts/plot_strings.py to read stdinNaohiro Tamura1-3/+8
This patch enables scripts/plot_strings.py to read a benchmark result file from stdin. To keep backward compatibility, that is to keep accepting multiple of benchmark result files in argument, blank argument doesn't mean stdin, but '-' does. Therefore nargs parameter of ArgumentParser.add_argument() method is not changed to '?', but keep '+'. ex: $ jq '.' bench-memset.out | plot_strings.py - $ jq '.' bench-memset.out | plot_strings.py - bench-memset-large.out $ plot_strings.py bench-memset.out bench-memset-large.out error ex: $ jq '.' bench-memset.out | plot_strings.py Reviewed-by: Siddhesh Poyarekar <siddhesh@sourceware.org>
2021-08-18Remove sysdeps/*/tls-macros.hFangrui Song1-22/+0
They provide TLS_GD/TLS_LD/TLS_IE/TLS_IE macros for TLS testing. Now that we have migrated to __thread and tls_model attributes, these macros are unused and the tls-macros.h files can retire. Reviewed-by: Szabolcs Nagy <szabolcs.nagy@arm.com>
2021-08-02Remove obsolete comments/name from several benchtest input files.Paul Zimmermann6-23/+0
These comments refer to slow paths that were removed in glibc 2.34 or earlier. The corresponding "names" that yield separate workload traces for "make bench" are thus obsolete. We are however keeping the corresponding inputs. Reviewed-by: Siddhesh Poyarekar <siddhesh@sourceware.org>
2021-08-02Remove obsolete comments/name from acos-inputs, since slow path was removed.Paul Zimmermann1-3/+0
2021-07-28tests: use xmalloc to allocate implementation arraySiddhesh Poyarekar1-2/+3
The benchmark and tests must fail in case of allocation failure in the implementation array. Also annotate the x* allocators in support.h so that the compiler has more information about them. Reviewed-by: Florian Weimer <fweimer@redhat.com>
2021-05-26benchtests: Fixed bench-memcpy-random: buf1: mprotect failedNaohiro Tamura1-2/+2
This patch fixed mprotect system call failure on AArch64. This failure happened on not only A64FX but also ThunderX2. Also this patch updated a JSON key from "max-size" to "length" so that 'plot_strings.py' can process 'bench-memcpy-random.out'
2021-05-23Bench: Add support for choose direction of memcpy in benchtestsNoah Goldstein3-65/+94
This patch adds support for testing memcpy with both dst > src and dst < src. Since memcpy is implemented as memmove which has seperate control flows for certain sizes depending on dst > src it seems like 1) information that should be provided in the benchtest output and a variable that can be controlled for the benchmarks. Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com>
2021-05-18x86: Expand bench-memcmp.c and test-memcmp.cNoah Goldstein1-6/+26
No bug. This commit adds some additional performance test cases to bench-memcmp.c and test-memcmp.c. The new benchtests include some medium range sizes, as well as small sizes near page cross. The new correctness tests correspond with the new benchtests though add some additional cases for checking the page cross logic. Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com> Reviewed-by: H.J. Lu <hjl.tools@gmail.com>
2021-05-17benchtests: Use JSON for bench-rawmemchr outputMatheus Castanho1-15/+39
Convert the output of benchtests/bench-rawmemchr to JSON like other string benchmarks. This makes the output more parseable and allows usage of compare_strings.py, for example. Reviewed-by: Lucas A. M. Magalhaes <lamm@linux.ibm.com>
2021-05-10add workload traces for cbrtlPaul Zimmermann2-0/+1008
These workload traces cover the whole "long double" range. This patch was prepared with the help of Adhemerval Zanella. Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2021-05-03Bench: Expand bench-memchr.cNoah Goldstein1-0/+13
No bug. This commit adds some additional cases for bench-memchr.c including testing medium sizes and testing short length with both an inbound match and out of bound match. Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com>
2021-05-03bench-memcpy: Collect data from 2KB to 4KBH.J. Lu1-0/+8
Collect data on memcpy from 2KB to 4KB with the 64-byte increment value.
2021-04-19x86: Expand test-memset.c and bench-memset.cNoah Goldstein1-2/+4
No bug. This commit adds tests cases and benchmarks for page cross and for memset to the end of the page without crossing. As well in test-memset.c this commit adds sentinel on start/end of tstbuf to test for overwrites Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com>
2021-04-18benchtests: Fix name of exp10f benchmark variantSiddhesh Poyarekar1-1/+1
Variant names don't accept brackets.
2021-04-18benchtests: Fix pthread-locks test to produce valid jsonSiddhesh Poyarekar2-8/+11
The benchtests json allows {function {variant}} categorization of results whereas the pthread-locks tests had {function {variant {subvariant}}}, which broke validation. Fix that by serializing the subvariants as variant-subvariant. Also update the schema to recognize the new benchmark attributes after fixing the naming conventions.
2021-04-16x86: Expanding test-memmove.c, test-memcpy.c, bench-memcpy-large.cnoah1-2/+6
No Bug. This commit expanding the range of tests / benchmarks for memmove and memcpy. The test expansion is mostly in the vein of increasing the maximum size, increasing the number of unique alignments tested, and testing both source < destination and vice versa. The benchmark expansaion is just to increase the number of unique alignments. test-memcpy, test-memccpy, test-mempcpy, test-memmove, and tst-memmove-overflow all pass. Signed-off-by: Noah Goldstein <goldstein.w.n@gmail.com>
2021-03-29add workload traces for missing functions (double format)Paul Zimmermann15-4/+13231
This patch adds workload traces for all double format functions where such files are missing. For each function, a set of 1000 random values is generated at random using SageMath, such that the output values are meaningful (for example avoiding too large inputs for exp10 where the output would be +Inf). More details about the generated values are given at the beginning of each file. Reviewed-by: Siddhesh Poyarekar <siddhesh@sourceware.org>
2021-03-16benchtests: Add ilogb* testsRaphael Moreira Zinsly4-2/+35
Add a benchtest to ilogb, ilogbf and ilogbf128 based on the logb* benchtests.
2021-02-10benchtests: Updated json bench-variant attributeNaohiro Tamura1-1/+1
This patch updates json "bench-variant" attribute of "bench-memset.c" to "default" so that the script "benchtests/scripts/plot_strings.py" can generate a file "memset_time_default_linear.png". Without this patch, the script "benchtests/scripts/plot_strings.py" generates a file "memset_time__linear.png" which has inconsistent form with "memcpy_time_default_linear.png" and "memmove_time_default_linear.png".
2021-02-08strchr: Add additional benchmarks and testsnoah1-1/+25
This patch adds additional benchmarks and tests for string size of 4096 and several benchmarks for string size 256 with different alignments.
2021-01-26benchtests: Do not build bench-timing-type with MODULE_NAME=libcArjun Shankar1-7/+7
Since commit 2682695e5c7a, `make bench-build' with `--enable-static-pie' fails due to bench-timing-type being incorrectly built with MODULE_NAME set to `libc'. This commit sets MODULE_NAME to nonlib, thus fixing the build failure. Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2021-01-11install: Replace scripts/output-format.sed with objdump -f [BZ #26559]Fangrui Song1-1/+0
GNU ld and gold have supported --print-output-format since 2011. glibc requires binutils>=2.25 (2015), so if LD is GNU ld or gold, we can assume the option is supported. lld is by default a cross linker supporting multiple targets. It auto detects the file format and does not need OUTPUT_FORMAT. It does not support --print-output-format. By parsing objdump -f, we can support all the three linkers. Reviewed-by: Adhemerval Zanella <adhemerval.zanella@linaro.org>
2021-01-02Update copyright dates with scripts/update-copyrightsPaul Eggert83-84/+84
I used these shell commands: ../glibc/scripts/update-copyrights $PWD/../gnulib/build-aux/update-copyright (cd ../glibc && git commit -am"[this commit message]") and then ignored the output, which consisted lines saying "FOO: warning: copyright statement not found" for each of 6694 files FOO. I then removed trailing white space from benchtests/bench-pthread-locks.c and iconvdata/tst-iconv-big5-hkscs-to-2ucs4.c, to work around this diagnostic from Savannah: remote: *** pre-commit check failed ... remote: *** error: lines with trailing whitespace found remote: error: hook declined to update refs/heads/master
2020-10-21New benchtest: pthread locksDJ Delorie2-1/+556
Performance benchmarks for various posix locks: mutex, rwlock, spinlock, condvar, and semaphore. Each test is performed with an empty loop body or with a computationally "interesting" (i.e. difficult to optimize away, and used just to allow lock code to be "hidden" in the filler's CPU cycles).
2020-09-24bench-strcmp.c: Add workloads on page boundaryH.J. Lu1-0/+56
Add strcmp workloads on page boundary.
2020-09-24bench-strncmp.c: Add workloads on page boundaryH.J. Lu1-0/+128
Add strncmp workloads on page boundary.
2020-09-23benchtests: Run _Float128 tests only on architectures that support itArjun Shankar4-7/+11
__float128 is a non-standard name and is not available on some architectures (like aarch64 or s390x) even though they may support the standard _Float128 type. Other architectures (like armv7) don't support quad-precision floating-point operations at all. This commit replaces benchtests references to __float128 with _Float128 and runs the corresponding tests only on architectures that support it.
2020-09-10benchtests: Add "workload" traces for sinf128Paul Zimmermann2-1/+2008
This patch adds workload traces for sinf128 in binary32. The trace is made of 1000 random numbers, generated with SageMath.
2020-09-10benchtests: Add "workload" traces for sinfPaul Zimmermann1-0/+2004
This patch adds workload traces for sinf in binary32. The trace is made of 1000 random numbers, generated with SageMath.
2020-09-10benchtests: Add "workload" traces for sinPaul Zimmermann1-0/+2004
This patch adds workload traces for sin in binary64. The trace is made of 1000 random numbers, generated with SageMath.
2020-09-10benchtests: Add "workload" traces for powf128Paul Zimmermann2-1/+1006
This patch adds workload traces for pow in binary128. The trace is made of 1000 random numbers, generated with SageMath.
2020-09-10benchtests: Add "workload" traces for powPaul Zimmermann1-0/+1002
This patch adds workload traces for pow in binary64. The trace is made of 1000 random numbers, generated with SageMath.
2020-09-10benchtests: Add "workload" traces for expf128Paul Zimmermann2-1/+1006
This patch adds workload traces for exp in binary128. The trace is made of 1000 random numbers, generated with SageMath.
2020-09-10benchtests: Add "workload" traces for expPaul Zimmermann1-0/+1002
This patch adds workload traces for exp in binary64. The trace is made of 1000 random numbers, generated with SageMath.
2020-08-04benchtests/README update.Paul Zimmermann1-6/+14
Improve documentation of the 'name' directive and the 'workload' mechanism. Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2020-07-13Remove --enable-obsolete-rpc configure flagPetr Vorel1-29/+0
Sun RPC was removed from glibc. This includes rpcgen program, librpcsvc, and Sun RPC headers. Also test for bug #20790 was removed (test for rpcgen). Backward compatibility for old programs is kept only for architectures and ABIs that have been added in or before version 2.28. libtirpc is mature enough, librpcsvc and rpcgen are provided in rpcsvc-proto project. NOTE: libnsl code depends on Sun RPC (installed libnsl headers use installed Sun RPC headers), thus --enable-obsolete-rpc was a dependency for --enable-obsolete-nsl (removed in a previous commit). The arc ABI list file has to be updated because the port was added with the sunrpc symbols Tested-by: Carlos O'Donell <carlos@redhat.com> Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2020-06-19benchtests: Add exp10f benchmarkAdhemerval Zanella2-1/+2390
It is based on expf one by converting each line with the formula: new_val = (float) log10 (exp ((double) old_val))
2020-06-05benchtests: Restore the clock_gettime optionH.J. Lu3-2/+17
commit 7621e38bf3c58b2d0359545f1f2898017fd89d05 Author: Wilco Dijkstra <Wilco.Dijkstra@arm.com> Date: Tue Jan 29 17:43:45 2019 +0000 Add generic hp-timing support removed the clock_gettime option. Restore the clock_gettime option for some x86 CPUs on which value from RDTSC may not be incremented at a fixed rate. Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2020-06-05Update HP_TIMING_NOW for _ISOMAC in sysdeps/generic/hp-timing.hH.J. Lu1-1/+0
commit e9698175b0b60407db1e89bcf29437ab224bca0b Author: Lukasz Majewski <lukma@denx.de> Date: Mon Mar 16 08:31:41 2020 +0100 y2038: Replace __clock_gettime with __clock_gettime64 breaks benchtests with sysdeps/generic/hp-timing.h: In file included from ./bench-timing.h:23, from ./bench-skeleton.c:25, from /export/build/gnu/tools-build/glibc-gitlab/build-x86_64-linux/benchtests/bench-rint.c:45: ./bench-skeleton.c: In function ‘main’: ../sysdeps/generic/hp-timing.h:37:23: error: storage size of ‘tv’ isn’t known 37 | struct __timespec64 tv; \ | ^~ Define HP_TIMING_NOW with clock_gettime in sysdeps/generic/hp-timing.h if _ISOMAC is defined. Don't define __clock_gettime in bench-timing.h since it is no longer needed. Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2020-05-20y2038: Replace __clock_gettime with __clock_gettime64Lukasz Majewski1-1/+1
The __clock_gettime internal function is not supporting 64 bit time on architectures with __WORDSIZE == 32 and __TIMESIZE != 64 (like e.g. ARM 32 bit). The __clock_gettime64 function shall be used instead in the glibc itself as it supports 64 bit time on those systems. This patch does not bring any changes to systems with __WORDSIZE == 64 as for them the __clock_gettime64 is aliased to __clock_gettime (in ./include/time.h).
2020-03-27Add benchtests for roundeven and roundevenf.Shen-Ta Hsieh3-2/+47
This patch adds benchtests for the roundeven and roundevenf functions. The inputs are copied from trunc-inputs.
2020-03-03Convert Python scripts to Python 3Alistair Francis2-2/+2
Change all of the #! lines in Python scripts that are called from Makefiles to reference /usr/bin/python3. All of the scripts called from Makefiles are already run with Python 3, so let's make sure they are explicitly using Python 3 if called manually.
2020-02-10Improve random memcpy benchmarkWilco Dijkstra1-29/+57
Improve the random memcpy benchmark. Double the number of copies and increase the memory sizes tested to 512KB. Add a more detailed distribution of memcpy alignment and sizes up to 4096 based on SPEC2017 traces. Reviewed-by: Siddhesh Poyarekar <siddhesh@sourceware.org>
2020-01-20Run bench-timing-type with newly built libc.Joseph Myers1-1/+4
benchtests/timing-type is built with the newly built libc, so should be run with it like actual tests and benchmarks.
2020-01-01Update copyright dates with scripts/update-copyrights.Joseph Myers82-82/+82