summary |
shortlog | log |
commit |
commitdiff |
tree
first ⋅ prev ⋅ next
Mark Wong [Mon, 7 Aug 2017 23:10:18 +0000 (16:10 -0700)]
Force csv.DictWriter to create unix file format
Mark Wong [Sun, 30 Jul 2017 23:19:35 +0000 (16:19 -0700)]
Always write results of a test to results.json
The idea is to keep things simple by having a directory of results per
test, and to have each directory with a consistently named results
files.
Mark Wong [Sat, 29 Jul 2017 00:51:05 +0000 (17:51 -0700)]
Capture uname information
It has some things that are not in the sysctl information. Like
hardware architecture.
Mark Wong [Fri, 28 Jul 2017 00:06:06 +0000 (17:06 -0700)]
Stop storing log files as json
Keep the json results document small by saving log information
externally. This include:
* postgres log
* pgbench output
* sar output
Mark Wong [Thu, 27 Jul 2017 00:51:59 +0000 (17:51 -0700)]
Fix use of env in call()
The env parameter to call() was clearing the PATH environment to only
have the postgres binary install path. Modify only the PATH
environment.
Mark Wong [Mon, 24 Jul 2017 04:50:14 +0000 (21:50 -0700)]
Install pgbench from contrib for older versions
Prior to 9.5, pgbench was in contrib.
Mark Wong [Mon, 24 Jul 2017 01:45:06 +0000 (18:45 -0700)]
Alter postgres options on the command line
This allows testing of older versions of postgres. Otherwise only
versions of postgres supporting ALTER SYSTEM (9.4+) will work with this
client.
Mark Wong [Fri, 28 Jul 2017 16:51:34 +0000 (09:51 -0700)]
Saved timestamp from test start
Mark Wong [Fri, 28 Jul 2017 16:50:14 +0000 (09:50 -0700)]
Use python2.7 from environment settings
Mark Wong [Tue, 18 Jul 2017 20:55:51 +0000 (13:55 -0700)]
Pythonic way to check for None
Also check to make sure files exist before trying to collect them.
Mark Wong [Tue, 18 Jul 2017 19:44:14 +0000 (12:44 -0700)]
Fix check for csv flag
Mark Wong [Tue, 18 Jul 2017 18:00:24 +0000 (11:00 -0700)]
Fix handling of csv option
Mark Wong [Thu, 20 Jul 2017 16:38:15 +0000 (09:38 -0700)]
pep8 coding style
Tomas Vondra [Thu, 13 Oct 2016 13:39:10 +0000 (15:39 +0200)]
also add CSV output to pgbench
Tomas Vondra [Thu, 13 Oct 2016 12:48:03 +0000 (14:48 +0200)]
add support for collecting results into simple CSV file
Originally the results were collected into a JSON format, which is
not very convenient when running ad-hoc benchmarks.
Tomas Vondra [Thu, 13 Oct 2016 12:27:25 +0000 (14:27 +0200)]
add shebang explicitly invoking Python 2.7
The code is not fully compatible with Python 3.x (although it should
not be a big deal to make that happen).
Tomas Vondra [Thu, 13 Oct 2016 11:47:33 +0000 (13:47 +0200)]
explicitly flush stdout in log()
Otherwise the messages may get buffered for a quite long time, which
is annoying, particularly in multi-process system.
Tomas Vondra [Thu, 13 Oct 2016 11:41:43 +0000 (13:41 +0200)]
fix lockups in PostgreSQL collector
When the workers produce results and return them through a queue, we need
to first drain the queue and then wait for the thread to join(). Otherwise
it seems to lock up - the join() call with wait as long as there are items
in the queue. This also happens because we do both things (reading from
queue and waiting for the thread) in the same thread.
Tomas Vondra [Thu, 13 Oct 2016 11:22:49 +0000 (13:22 +0200)]
open connections in a way resilient to temporary failures
In case of connection failure (e.g. a backend getting terminated by
OOM killer and taking down the whole server), the workers failed
with an exception without putting a result into the queue, leading
to hangs.
This fixes that by making the workers resilient to connection issues
by catching the exceptions and terminating nicely. Also, we retry
connection several times, to continue with benchmarking even after
OOM hits us unexpectedly, etc.
Tomas Vondra [Thu, 11 Aug 2016 00:00:32 +0000 (02:00 +0200)]
Check configuration before running any benchmarks
Before doing any heavy-lifting, check existence of directories,
binaries and some other sanity checks.
Tomas Vondra [Thu, 11 Aug 2016 00:08:06 +0000 (02:08 +0200)]
Fix CWD when running 'git pull', fix parameters.
When refreshing a reporitory clone, running 'git pull $dir' does
not do the trick - it assumes the CWD is the clone, and imports
data from repository at $dir. So we need to set CWD properly and
do just 'git pull'.
Also, prefix class members with 'self'.
Tomas Vondra [Wed, 10 Aug 2016 22:58:43 +0000 (00:58 +0200)]
Add .lock to .gitignore
Tomas Vondra [Wed, 10 Aug 2016 22:46:26 +0000 (00:46 +0200)]
Rework the perffarm client configuration.
Instead of configuration hardcoded into the perffrarm-client.py
script, move it into a separate settings.py file, and allow
override using settings_local.py (not required).
Also somewhat improve the benchmark configurations by allowing
specifying number of runs, durations etc. in the configuration
file (instead of using default parameter values).
Tomas Vondra [Wed, 10 Aug 2016 22:06:11 +0000 (00:06 +0200)]
Handle missing sar stats gracefully
Tomas Vondra [Wed, 10 Aug 2016 21:23:55 +0000 (23:23 +0200)]
Import initial version of the client
Dave Page [Tue, 15 Mar 2016 11:36:06 +0000 (11:36 +0000)]
Update requirements.txt
Dave Page [Tue, 15 Mar 2016 11:31:53 +0000 (11:31 +0000)]
Add PG Community Auth support.
Dave Page [Tue, 15 Mar 2016 09:40:11 +0000 (09:40 +0000)]
Cute-ify the name.
Dave Page [Mon, 14 Mar 2016 16:59:37 +0000 (16:59 +0000)]
Nice logo
Dave Page [Mon, 14 Mar 2016 15:26:32 +0000 (15:26 +0000)]
Add boilerplate legal stuff.
Dave Page [Mon, 14 Mar 2016 14:38:36 +0000 (14:38 +0000)]
Fix the responsive navbar.
Dave Page [Mon, 14 Mar 2016 14:18:29 +0000 (14:18 +0000)]
Add a basic Bootstrap template.
Dave Page [Mon, 14 Mar 2016 12:49:35 +0000 (12:49 +0000)]
Fix ACL
Dave Page [Mon, 14 Mar 2016 12:49:07 +0000 (12:49 +0000)]
403/404 error pages.
Dave Page [Mon, 14 Mar 2016 12:18:13 +0000 (12:18 +0000)]
Cleanup layout, and ensure templates/static files work.
Dave Page [Mon, 14 Mar 2016 11:33:05 +0000 (11:33 +0000)]
Fix some minor errors/typos
Dave Page [Mon, 14 Mar 2016 11:31:30 +0000 (11:31 +0000)]
Move the requirements.txt for the web site as the client will need one too.
Dave Page [Mon, 14 Mar 2016 11:29:18 +0000 (11:29 +0000)]
Initial import of a framework Django app.