chromiumos/platform/punybench.git
6 hours agoAdded a PRESUBMIT.cfg file to punybench 19/56419/2 master
Paul Taysom [Thu, 23 May 2013 17:18:12 +0000 (10:18 -0700)]
Added a PRESUBMIT.cfg file to punybench

To avoid having to use --no-verify, I've added a PRESUMIT.cfg
file to punybench that turns off checking for the copywrite
and tabs.

BUG=chromium:243368
TEST=repo upload .

Change-Id: If49b0a24463fb278c54c539e0f19efb47006cdb8
Reviewed-on: https://gerrit.chromium.org/gerrit/56419
Tested-by: Paul Taysom <taysom@chromium.org>
Reviewed-by: Luigi Semenzato <semenzato@chromium.org>
Commit-Queue: Paul Taysom <taysom@chromium.org>

2 months agoAdjusted memory usage in puny benchmarks 32/45432/2 factory-4128.B factory-spring-3842.B factory-spring-4131.B release-R27-3912.B release-R28-4100.B stabilize-3881.0.B stabilize-3912.79.B stabilize-4008.0.B stabilize-4035.0.B stabilize-4068.0.B toolchainA
Paul Taysom [Thu, 14 Mar 2013 16:43:57 +0000 (09:43 -0700)]
Adjusted memory usage in puny benchmarks

Reduced memory usage of puny benchmarks to
reduce the probability of ooming when tests
are run multiple times.

BUG=chromium-os:39629
TEST=./run_remote_tests.sh --use_emerged --board=$B --remote=$IP \
kernel_fs_Punybench/control.daily

Change-Id: I83c7e88388e0ac58879ea366867aa335273b8304
Reviewed-on: https://gerrit.chromium.org/gerrit/45432
Tested-by: Paul Taysom <taysom@chromium.org>
Reviewed-by: Luigi Semenzato <semenzato@chromium.org>
Commit-Queue: Paul Taysom <taysom@chromium.org>

4 months agoHad to tweak memory hogged 87/41587/4 firmware-spring-3824.4.B firmware-spring-3824.55.B firmware-spring-3824.B firmware-spring-3833.B release-R26-3701.B stabilize-3658.0.0 stabilize-3701.30.0 stabilize-3701.30.0b stabilize-3701.46.B stabilize-3701.81.B stabilize-bluetooth-smart toolchain-3701.42.B
Paul Taysom [Thu, 17 Jan 2013 23:07:16 +0000 (15:07 -0800)]
Had to tweak memory hogged

Took too much memory, many times tests ran out of memory.

BUG=chromium-os:35390
TEST=kernel_fs_Punybench --args=--disk

Change-Id: Icd9a83eaa68c70d4a36ef336cdc8e8b579726480
Reviewed-on: https://gerrit.chromium.org/gerrit/41587
Tested-by: Paul Taysom <taysom@chromium.org>
Reviewed-by: Luigi Semenzato <semenzato@chromium.org>
Commit-Queue: Paul Taysom <taysom@chromium.org>

4 months agoRemove extra printfs from uwrite 64/41464/2
Paul Taysom [Wed, 16 Jan 2013 22:39:56 +0000 (14:39 -0800)]
Remove extra printfs from uwrite

Missed some printfs in a test. This broke
the post processing of the test output.

BUG=chromium-os:37961
TEST=kernel_fs_Punybench --args=--disk

Change-Id: Ic4c6fedd787927cabe9a18b6965e5c9202975810
Reviewed-on: https://gerrit.chromium.org/gerrit/41464
Tested-by: Paul Taysom <taysom@chromium.org>
Reviewed-by: Luigi Semenzato <semenzato@chromium.org>
Commit-Queue: Paul Taysom <taysom@chromium.org>

4 months agoAdded features to speed up tests 14/41314/3
Paul Taysom [Wed, 16 Jan 2013 00:03:03 +0000 (16:03 -0800)]
Added features to speed up tests

Added features and set default args to use memory hog to
speed up tests.

BUG=chromium-os:35390
TEST=ran punybench disk tests and compared results

Change-Id: Ic79df62952e5fe360dd7da42f287efbb6915a831
Reviewed-on: https://gerrit.chromium.org/gerrit/41314
Reviewed-by: Luigi Semenzato <semenzato@chromium.org>
Tested-by: Paul Taysom <taysom@chromium.org>
Commit-Queue: Paul Taysom <taysom@chromium.org>

6 months agoCompiled punybench to be position independent 98/38198/2 factory-3536.B release-R25-3428.B stabilize-3428.110.0 stabilize-3428.149 stabilize-3428.149.B stabilize-3428.193 stabilize2 toolchain-3428.65.B
Paul Taysom [Fri, 16 Nov 2012 15:48:18 +0000 (07:48 -0800)]
Compiled punybench to be position independent

Added -fPIC to the CFLAGS in the make files

BUG=chromium-os:36264
TEST=used make directly, downloaded executables, ran punybench tests

Change-Id: Ib2adfc3f5b14d3c4a7a6447a068aedd76cd5ff75
Reviewed-on: https://gerrit.chromium.org/gerrit/38198
Tested-by: Paul Taysom <taysom@chromium.org>
Reviewed-by: Mandeep Singh Baines <msb@chromium.org>
Commit-Ready: Paul Taysom <taysom@chromium.org>

6 months agoTest for boot cache device mapper 64/35464/7
Paul Taysom [Fri, 12 Oct 2012 22:40:09 +0000 (15:40 -0700)]
Test for boot cache device mapper

Test verifies build boot cache and verifies the resulting block map.
Test corrupts the block map and verifies it still works.

BUG=chromium-os:25441
TEST=ran on stumpy

Change-Id: Id6ecaaf57a0e3da0af140ce419a5f5dd83cb3156
Reviewed-on: https://gerrit.chromium.org/gerrit/35464
Reviewed-by: Paul Taysom <taysom@chromium.org>
Tested-by: Paul Taysom <taysom@chromium.org>
Reviewed-by: Mandeep Singh Baines <msb@chromium.org>
Commit-Ready: Paul Taysom <taysom@chromium.org>

6 months agoAdded running averages to hammer test 22/37722/3
Paul Taysom [Fri, 9 Nov 2012 17:39:42 +0000 (09:39 -0800)]
Added running averages to hammer test

The hammer test puts on a file system load.
It displayed how many bytes per second it
was writing. It now keeps a running average.
Added features for testing Parrot disk problem.

BUG=chromium-os:36207
TEST=parrot, amd, arm

Change-Id: Ib294a646a77856bf8b5c9442ddd69c9c2c2931ee
Reviewed-on: https://gerrit.chromium.org/gerrit/37722
Reviewed-by: Don Garrett <dgarrett@chromium.org>
Commit-Ready: Paul Taysom <taysom@chromium.org>
Tested-by: Paul Taysom <taysom@chromium.org>
6 months agoLibrary routine for hogging memory
Paul Taysom [Fri, 26 Oct 2012 21:17:54 +0000 (14:17 -0700)]
Library routine for hogging memory

So the file system tests can use smaller data sets
so they can run faster but still get good numbers
from the tests, the hog memory routines malloc most
of the memory in the system.

uread now runs about 10 times faster but still gives
the same performance numbers.

BUG=chromium-os:35390
TEST=ran uread on x86 and ARM

Change-Id: Ia442b1d784a57f356c3f4d9b5be1a192c2a4819a
Reviewed-on: https://gerrit.chromium.org/gerrit/36724
Commit-Ready: Paul Taysom <taysom@chromium.org>
Reviewed-by: Paul Taysom <taysom@chromium.org>
Tested-by: Paul Taysom <taysom@chromium.org>
7 months agoTest to stress writing the disk
Paul Taysom [Tue, 9 Oct 2012 22:43:58 +0000 (15:43 -0700)]
Test to stress writing the disk

This test hammers the disk with rights until someone breaks out
of it.

BUG=chromium-os:34931
TEST=ran hammer from shell on stumpy

Change-Id: Iecae95adfb39a734378c268cb84b51da7b4cb262
Reviewed-on: https://gerrit.chromium.org/gerrit/35064
Commit-Ready: Paul Taysom <taysom@chromium.org>
Reviewed-by: Paul Taysom <taysom@chromium.org>
Tested-by: Paul Taysom <taysom@chromium.org>
12 months agoPunybench build process cleanups 32/21632/1 factory-2268.16.B factory-2305.B factory-2338.B factory-2368.B factory-2394.B factory-2460.B factory-2475.B factory-2569.B factory-2717.B factory-2723.14.B factory-2846.B factory-2848.B factory-2914.B factory-2985.B factory-2993.B factory-3004.B firmware-butterfly-2788.B firmware-link-2348.B firmware-link-2695.2.B firmware-link-2695.B firmware-parrot-2685.B firmware-snow-2695.90.B firmware-snow-2695.B firmware-stout-2817.B release-R20-2268.B release-R21-2465.B release-R22-2723.B release-R23-2913.B stabilize stabilize-daisy stabilize-link stabilize-link-2913.278
Taylor Hutt [Wed, 2 May 2012 17:08:47 +0000 (10:08 -0700)]
Punybench build process cleanups

Paul preferred the more common '-include' idiom, so this changes the
build to use that.

Also deleted 'arm.mk', which was a NOP file.

BUG=none
TEST=Inspection, and tested building with a non-existant architecture file.

Change-Id: I647d0dfc7d769d747092143026447ef5c45dd363
Signed-off-by: Taylor Hutt <thutt@chromium.org>
12 months agoPunybench build process cleanups 06/21506/1
Taylor Hutt [Tue, 1 May 2012 02:03:48 +0000 (19:03 -0700)]
Punybench build process cleanups

Punybench build process will attempt to include a Makefile snippet for
the defined target architecture, and it will fail if the architecture
file is not present.

To prevent the error, the build system will now only include the file
if it exists; I also removed two architecture files which did nothing,
but were present so they could be included.

Finally, I made the 'makedir' variable hold an absolute pathname
instead of a relative pathname; if the build process fails, it will
show an absolute pathname now.

BUG=none
TEST=Inspection, and tested building with a non-existant architecture file.

Change-Id: I8dc3449b310677f88347980394d1abfaeaf0f785
Signed-off-by: Taylor Hutt <thutt@chromium.org>
13 months agoLseek as additional valid whence values 60/19460/3
Paul Taysom [Mon, 2 Apr 2012 14:37:45 +0000 (07:37 -0700)]
Lseek as additional valid whence values

Test for invalid whence had to be changed to account for new values.

BUG=chromium-os:28569
TEST=ran fcalls on stumpy

Change-Id: I64983396592cff7998e3d56a01756e44b4aa909b

13 months agoTest for measuring operations like divide 66/19166/2
Paul Taysom [Tue, 27 Mar 2012 16:40:43 +0000 (09:40 -0700)]
Test for measuring operations like divide

BUG=chromium-os:28505
TEST=ran on kaen and z600

Change-Id: I6e4063aa7a673b94e595a72a28dd70b80e2082f1

14 months agoChanged buffers to larger for memcpy_test 62/18362/1 factory-1987.B release-R19-2046.B
Paul Taysom [Fri, 16 Mar 2012 00:28:02 +0000 (17:28 -0700)]
Changed buffers to larger for memcpy_test

BUG=chromium-os:27742
TEST=on stumpy

Change-Id: I1fe4f8440d1eda7717d107a76d8e19be58b2302a

14 months agoA better estimate for write IOPs 68/18068/2
Paul Taysom [Wed, 14 Mar 2012 00:13:26 +0000 (17:13 -0700)]
A better estimate for write IOPs

Added a new test that gives a better estimate of IOPs for eMMC
storage.

Will still need to add this to autotests.

BUG=chromium-os:27763
TEST=z600, Kaen

Change-Id: I7a3082fbc8d81bfe0f963b27a553d921edcd4e8e

14 months agoMake uwrite like uread 13/17013/5
Paul Taysom [Tue, 28 Feb 2012 22:35:43 +0000 (14:35 -0800)]
Make uwrite like uread

Enhanced uwrite so it can be used to measure write performance.
Added uwriterand for measuring synchronous random writes.

BUG=chromium-os:27012
TEST=ran on stumpy and z600

Change-Id: If1dbc3a52ba4d527998d696ead819df1766c7860

16 months agossdwritetest - write all over a device and measure 57/13957/2 release-R18-1660.B
Luigi Semenzato [Tue, 10 Jan 2012 21:10:34 +0000 (13:10 -0800)]
ssdwritetest - write all over a device and measure
the time taken by each write operation.

BUG=chromium-os:24919
TEST=I ran this with various parameters on an Alex SSD (SanDisk P4)

Change-Id: I5da60601c9c86756141b8e9b056906ff3b3e5a72

17 months agoAdded memory read and write tests 27/12227/3 factory-1412.B release-R17-1412.B
Paul Taysom [Tue, 29 Nov 2011 23:07:27 +0000 (15:07 -0800)]
Added memory read and write tests

BUG=chromium-os:23110
TEST=autotest control.kernel_fs_performance

Change-Id: I3f8cfe4a4b9f481150add9c6beafe7d4e737c20a

17 months agoFix incorrect free(). 57/12157/1
Luigi Semenzato [Mon, 28 Nov 2011 23:25:22 +0000 (15:25 -0800)]
Fix incorrect free().
BUG=chromium-os:23501
TEST=none (well I ran it and it works now)

Change-Id: Ic6c1330f725e72485ada53eec86b908e36904f78

18 months agoAdded more cleanup on errors. 86/11786/3
Paul Taysom [Wed, 16 Nov 2011 21:31:26 +0000 (13:31 -0800)]
Added more cleanup on errors.

Added support for better clean up on errors for
puny benchmarks. Threadtree is the first test
to use this new facility.

BUG=chromium-os:22615
TEST=x86 and x86_64 compile on arm

Change-Id: I5b9e1a1ab79a342aaa51aaf4c561dc674beac0d9

18 months agoBetter units for measurements 33/11233/3 factory-1284.B firmware-kiev-2.112.B firmware-uboot_v2-1299.B
Paul Taysom [Fri, 4 Nov 2011 20:49:58 +0000 (13:49 -0700)]
Better units for measurements

Print MiB/sec for uread and ureadrand
and IOPs/sec for ureadrand.

BUG=chromium-os:22532
TEST=x86 and z600

Change-Id: Ib3749cfdeaacb26ca2ead532c461588dbc0dc463

18 months agoPunybenchmarks for APPLE changes 28/10728/1 factory-1235.B
Paul Taysom [Wed, 26 Oct 2011 18:06:45 +0000 (11:06 -0700)]
Punybenchmarks for APPLE changes

These makefiles don't support an Apple but they make it easier
for a different set of makefiles for the Apple to work.

BUG=chromium-os:18097
TEST=built for alex, kaen, and the .c's on a mac

Change-Id: Id84ce3d9101dd2dc1ebb67016f80274c4b0e321c

19 months agoTests concurrent creat/unlink of files 20/10420/3
Paul Taysom [Thu, 20 Oct 2011 16:39:35 +0000 (09:39 -0700)]
Tests concurrent creat/unlink of files

Threadfile tests concurrent creation of tests in the same directory.
To let the tests run freely, they needed to be able to create names
that wouldn't collide. Added Mersenne Twister pseudorandom number
generator with thread support.

BUG=chromium-os:21895
TEST=ran on x86-alex encrypted file system

Change-Id: I67ce330eb2b08621a156c601d90ac82c1ab74662

19 months agoGoing to kernel style for C code. 68/8768/3 release-R16-1193.B
Paul Taysom [Tue, 4 Oct 2011 23:10:09 +0000 (16:10 -0700)]
Going to kernel style for C code.

BUG=chromium-os:21252
TEST=x86, arm

Change-Id: I32da04137479ea2f32df6c36749f5583b0ca1587

19 months agoRevert "Fixed indentation and white spacing." 64/8764/1
Paul Taysom [Tue, 4 Oct 2011 22:48:55 +0000 (15:48 -0700)]
Revert "Fixed indentation and white spacing."

This reverts commit f3b4bf1eaa801c035aa8af0b38957534d629db5e

The standard is to use kernel style for C code.

19 months agoFixed indentation and white spacing. 53/8753/1
Paul Taysom [Tue, 4 Oct 2011 21:34:19 +0000 (14:34 -0700)]
Fixed indentation and white spacing.

BUG=chromium-os:21252
TEST=x86 and arm

Change-Id: I05f9aee4d6de17f9cf6905359e2136c2da81dca9

19 months agoAdded some options to inplace. 82/8582/1
Paul Taysom [Fri, 30 Sep 2011 22:58:16 +0000 (15:58 -0700)]
Added some options to inplace.

Getting punybench in shape for major clean up.

BUG=chromium-os:21109
TEST=x86

Change-Id: Ic12be65811c97601d7b0a9f54cb6f44f3121ded4

19 months agoAdded more tests to fcalls 38/7538/3
Paul Taysom [Mon, 12 Sep 2011 17:19:36 +0000 (10:19 -0700)]
Added more tests to fcalls

BUG=chromium-os:17389
TEST=ARM and x86

Change-Id: Icfd78ac60ecd77d27a675d5cb0f135e8fcf8b0c1

20 months agoRefinement of several tests 41/7341/2 factory-1020.B
Paul Taysom [Wed, 7 Sep 2011 18:06:22 +0000 (11:06 -0700)]
Refinement of several tests

Fixed problem in ptrchase
Made default parameters match tests

BUG=chromium-os:19545
TEST=alex

Change-Id: I9cc56e424d872e2e2bb38dfd5a4176a14f836479

20 months agoNew pointer chasing test and clean up 30/6930/2 release-1011.B
Paul Taysom [Tue, 30 Aug 2011 21:39:56 +0000 (14:39 -0700)]
New pointer chasing test and clean up

BUG=chromium-os:19545
TEST=ran on alex, aebl, mario, z600, mac

Change-Id: I81caa73cd30e6aacd3e34d38d22051f401c7c239

20 months agomemcpy tests 19/6519/2 factory-980.B test-982.B
Paul Taysom [Tue, 23 Aug 2011 20:40:29 +0000 (13:40 -0700)]
memcpy tests

BUG=chromium-os:19545
TEST=ran on ARM and x86

Change-Id: I742b16349e3950633342efe418626b4a950bfccc

21 months agoWrappers for file system interfaces. 67/4867/1
Paul Taysom [Wed, 27 Jul 2011 22:54:25 +0000 (15:54 -0700)]
Wrappers for file system interfaces.

Added more wrappers and cleaned up wrapper code.

BUG=chromium-os:17389
TEST=built of alex and aebl, ran on aebl

Change-Id: Iffb644a682bbf55af29affc8092647066b114368

22 months agoNew File System tests. 52/4052/5 0.14.811.B 0.15.877.B firmware-881-u-boot-v1 firmware-u-boot-v1
Paul Taysom [Wed, 13 Jul 2011 21:23:07 +0000 (14:23 -0700)]
New File System tests.

Added rename of mylib.h to mystdlib.h

BUG=chromium-os:17389
TEST=ran on Alex

Change-Id: Ie61dd49d880c4128fdd6918a890a47e91e0a5771

22 months agoCleanup of library 66/3866/2 780.B
Paul Taysom [Mon, 11 Jul 2011 16:44:53 +0000 (09:44 -0700)]
Cleanup of library

1. Local options can override global options
2. Changed name of range function to urand
3. Cleanup trailing white space
4. Add fill benchmark for measuring file system behavior
when filling file system.

BUG=17388
TERST=compiled all tests for x86 and ARM

Change-Id: I40cf38f45a7576c1ae3af9f13dc4fc81b0a52e1e

22 months agoRandom read test 00/3800/2
Paul Taysom [Fri, 8 Jul 2011 19:55:11 +0000 (12:55 -0700)]
Random read test

BUG=chromium-os:17386
TEST=ran and reported results on ARM and x86

Change-Id: I56d4014f360bb484d5a0544f233be958665ab523

22 months agoFixes needed for ebuild to work 59/3459/2
Paul Taysom [Thu, 30 Jun 2011 16:33:53 +0000 (09:33 -0700)]
Fixes needed for ebuild to work

BUG=chromiun-os:13358
TEST=ran on alex and kaen

Change-Id: I6112bc57414cd608c4b554fbd9828487e815e45e

2 years agoinit punybench 35/835/1
Paul Taysom [Thu, 12 May 2011 22:43:59 +0000 (15:43 -0700)]
init punybench