Marko Kreen [Wed, 24 Nov 2010 20:27:21 +0000 (22:27 +0200)]
tests/merge: make it work again
Marko Kreen [Wed, 24 Nov 2010 20:19:48 +0000 (22:19 +0200)]
testlib: nicer psql launcher
Marko Kreen [Wed, 24 Nov 2010 20:19:02 +0000 (22:19 +0200)]
pgq_node.set_partition_watermark: finally sync with other pgq_node cleanups
Marko Kreen [Wed, 24 Nov 2010 20:18:22 +0000 (22:18 +0200)]
pgq.BatchWalker: relaxed __len__(), ignore out-of-order calls
Marko Kreen [Wed, 24 Nov 2010 20:16:51 +0000 (22:16 +0200)]
CascadedWorker: override is_batch_done
To allow combined-branch get more that one batch ahead.
Marko Kreen [Wed, 24 Nov 2010 09:48:51 +0000 (11:48 +0200)]
refresh libusual
Marko Kreen [Wed, 24 Nov 2010 09:48:09 +0000 (11:48 +0200)]
pgqd: report database removal
Marko Kreen [Wed, 24 Nov 2010 09:11:34 +0000 (11:11 +0200)]
londiste copy: survive remove-table
Marko Kreen [Tue, 23 Nov 2010 12:06:02 +0000 (14:06 +0200)]
pgq_node: add version() function, bump ver in pgq and londiste schemas.
All code has seen various fixes, this will help detect old versions.
Marko Kreen [Tue, 23 Nov 2010 10:28:57 +0000 (12:28 +0200)]
londiste.get_table_list: allow merge-leafs have different tables
try to account only nodes that have particular table
Marko Kreen [Mon, 22 Nov 2010 23:03:14 +0000 (01:03 +0200)]
pgqd: sync with cfparser changes
Marko Kreen [Fri, 19 Nov 2010 13:07:07 +0000 (15:07 +0200)]
testlib cleanup fixes
Marko Kreen [Thu, 11 Nov 2010 11:24:07 +0000 (13:24 +0200)]
Cleanup for the new querybuilder functions
Asko Oja [Wed, 10 Nov 2010 23:02:10 +0000 (23:02 +0000)]
helper functions added into querybuilder
Marko Kreen [Wed, 10 Nov 2010 15:46:46 +0000 (17:46 +0200)]
pgqd: tilde expansion for pidfile and logfile
Patch by Asko Tiidumaa
Marko Kreen [Wed, 10 Nov 2010 12:32:46 +0000 (14:32 +0200)]
set_tcp_keepalive: check socket.fromfd(), its missing on win32
Marko Kreen [Tue, 9 Nov 2010 13:37:12 +0000 (15:37 +0200)]
pgq.maint_rotate_tables: detect and report tick inconsistency
Aleksei Plotnikov [Thu, 4 Nov 2010 13:26:55 +0000 (13:26 +0000)]
changed syslog handler to send service type
Marko Kreen [Thu, 4 Nov 2010 12:06:40 +0000 (14:06 +0200)]
refresh libusual
Marko Kreen [Wed, 3 Nov 2010 15:57:33 +0000 (17:57 +0200)]
Restore old compat package location.
Workaround for broken debian broke it, needs bit different owrkaround later.
Marko Kreen [Wed, 3 Nov 2010 15:50:10 +0000 (17:50 +0200)]
pgqd: apply connection lifetime to ticker connection
Marko Kreen [Wed, 3 Nov 2010 15:49:42 +0000 (17:49 +0200)]
refresh libusual
Aleksei Plotnikov [Tue, 2 Nov 2010 13:51:22 +0000 (15:51 +0200)]
added syslog logging handler with hostname support
Marko Kreen [Tue, 2 Nov 2010 13:25:51 +0000 (15:25 +0200)]
dbservice: use txid_current() instead of old name
Marko Kreen [Tue, 2 Nov 2010 13:25:06 +0000 (15:25 +0200)]
dbstruct: use adbin instead of adsrc when detecting default
Marko Kreen [Mon, 1 Nov 2010 15:44:21 +0000 (17:44 +0200)]
deb: fwd-port fix for braindamaged Debian's python
They broke distutils install just for fun, thus each
python .deb needs their braindamaged hack to work.
Marko Kreen [Mon, 1 Nov 2010 15:18:49 +0000 (17:18 +0200)]
skytools.Config: fix bug in has_option()
Marko Kreen [Mon, 1 Nov 2010 15:16:48 +0000 (17:16 +0200)]
pgqd: do reset_logging() in cleanup(), bit cleaner shutdown
Marko Kreen [Wed, 27 Oct 2010 15:08:23 +0000 (18:08 +0300)]
pgq_node.drop_node: simplify
- londiste data is removed by cascaded fkey
- use force when dropping queue
Marko Kreen [Wed, 27 Oct 2010 14:58:49 +0000 (17:58 +0300)]
pgq.tune_storage: turn autovac off for queue tables
Marko Kreen [Wed, 27 Oct 2010 14:57:39 +0000 (17:57 +0300)]
pgq.drop_queue: add force flag
Marko Kreen [Mon, 25 Oct 2010 10:25:03 +0000 (13:25 +0300)]
Fix pgq.next_batch_custom()
Seems it was broken in some reorg.
Marko Kreen [Mon, 25 Oct 2010 07:52:54 +0000 (10:52 +0300)]
Install queue_mover3
Marko Kreen [Wed, 20 Oct 2010 11:35:02 +0000 (14:35 +0300)]
checker: compare-repair-apply
Marko Kreen [Wed, 20 Oct 2010 10:04:39 +0000 (13:04 +0300)]
pgq: fix table reference
Marko Kreen [Tue, 19 Oct 2010 11:56:26 +0000 (14:56 +0300)]
cascadedconsumer: missing return in get_consumer_state
Marko Kreen [Tue, 19 Oct 2010 08:54:50 +0000 (11:54 +0300)]
dbsctruct: fix reorg
Marko Kreen [Wed, 13 Oct 2010 13:58:53 +0000 (16:58 +0300)]
londiste: trigger-cleanup trigger on londiste.table_info
Marko Kreen [Wed, 13 Oct 2010 13:57:37 +0000 (16:57 +0300)]
skytools.checker: fix, add repair-apply mode
Marko Kreen [Tue, 12 Oct 2010 13:26:43 +0000 (16:26 +0300)]
londiste: automatic db upgrade
this is an experiment...
Marko Kreen [Tue, 12 Oct 2010 13:26:04 +0000 (16:26 +0300)]
londiste: "on delete cascade" fkeys for tables
this avoids need to write cleanup code
Marko Kreen [Tue, 12 Oct 2010 12:50:12 +0000 (15:50 +0300)]
hack: cascadedconsumer send standby info
Marko Kreen [Tue, 12 Oct 2010 12:32:23 +0000 (15:32 +0300)]
londiste.root_check_seqs: lock node row
Marko Kreen [Tue, 12 Oct 2010 12:16:39 +0000 (15:16 +0300)]
refresh libusual
Marko Kreen [Tue, 12 Oct 2010 12:15:57 +0000 (15:15 +0300)]
doc: fix make rules
Marko Kreen [Tue, 12 Oct 2010 12:13:30 +0000 (15:13 +0300)]
todo update, move existing stuff to NEWS
Marko Kreen [Tue, 12 Oct 2010 12:09:20 +0000 (15:09 +0300)]
cascadeadmin: remove obsolete entries from help text
Marko Kreen [Tue, 12 Oct 2010 12:08:18 +0000 (15:08 +0300)]
skytools.checker: generalize more
Marko Kreen [Tue, 12 Oct 2010 11:58:29 +0000 (14:58 +0300)]
move londiste & pgq_node maint into pgq.maint_operations
Marko Kreen [Tue, 12 Oct 2010 11:46:37 +0000 (14:46 +0300)]
Use different SQL for trigger detection on Postgres 9.0
Marko Kreen [Tue, 12 Oct 2010 11:40:24 +0000 (14:40 +0300)]
drop_node: fix message
Marko Kreen [Tue, 12 Oct 2010 11:39:26 +0000 (14:39 +0300)]
use defa sklog
Marko Kreen [Tue, 12 Oct 2010 11:37:29 +0000 (14:37 +0300)]
configure: --with-skylog arg to set default value
Marko Kreen [Thu, 23 Sep 2010 00:52:16 +0000 (17:52 -0700)]
more checker
Asko Oja [Sat, 18 Sep 2010 16:43:23 +0000 (16:43 +0000)]
duplicated repair and compart into checker for crossmover
Marko Kreen [Tue, 28 Sep 2010 21:16:21 +0000 (14:16 -0700)]
new dbservice module, for pl/python funcs
Marko Kreen [Thu, 23 Sep 2010 00:52:39 +0000 (17:52 -0700)]
skytools: JSON wrapper
- find working JSON module
- easier kwargs API
Marko Kreen [Fri, 17 Sep 2010 03:12:00 +0000 (06:12 +0300)]
londiste: helpstr reorg, add --reset and --rewind
Marko Kreen [Fri, 17 Sep 2010 03:11:37 +0000 (06:11 +0300)]
CascadedConsumer: --reset and --rewind commands
Marko Kreen [Wed, 15 Sep 2010 13:22:42 +0000 (16:22 +0300)]
londiste: use londiste.upgrade.2to3.sql for ugprade instead of hacking around
Marko Kreen [Wed, 15 Sep 2010 13:01:35 +0000 (16:01 +0300)]
Refresh libusual
Marko Kreen [Wed, 15 Sep 2010 08:24:20 +0000 (11:24 +0300)]
skytools: Support psycopg 2.2
There fileno() has moved from cursor to connection.
Marko Kreen [Tue, 14 Sep 2010 10:17:35 +0000 (13:17 +0300)]
skytools.config: apply defaults to only main section
Otherwise they appear in all sections.
Patch by Martin Otto
Marko Kreen [Tue, 14 Sep 2010 09:44:31 +0000 (12:44 +0300)]
skytools.config: always check main section
Patch by Martin Otto
Marko Kreen [Tue, 14 Sep 2010 08:37:55 +0000 (11:37 +0300)]
pgqd: remove leftover _exit()
Marko Kreen [Mon, 6 Sep 2010 13:12:18 +0000 (16:12 +0300)]
pgq/triggers: throw error if SKIP if used in AFTER trigger.
Marko Kreen [Mon, 6 Sep 2010 12:57:13 +0000 (15:57 +0300)]
londiste,pgq: Support & use TRUNCATE trigger by default.
Event format:
ev_type - R
ev_extra1 - table name
Works only on Postgres 8.4+.
Patch by Hannu Krosing.
Marko Kreen [Fri, 3 Sep 2010 14:08:38 +0000 (17:08 +0300)]
sql/ticker: make new logic actually work
Marko Kreen [Fri, 3 Sep 2010 14:03:16 +0000 (17:03 +0300)]
pgq.maint_operations: don't do rotate_step2, if nothing to rotate
Marko Kreen [Fri, 3 Sep 2010 10:53:31 +0000 (13:53 +0300)]
configure: enable asciidoc/xmlto automatically, if building from .git
Marko Kreen [Thu, 2 Sep 2010 14:56:56 +0000 (17:56 +0300)]
pgq/trigger: add when= argument to sqltriga/logutriga.
Similar to WHEN argument for CREATE TRIGGER in 9.0.
Marko Kreen [Wed, 1 Sep 2010 14:32:00 +0000 (17:32 +0300)]
Add more junk to gitignore
Marko Kreen [Wed, 1 Sep 2010 14:31:40 +0000 (17:31 +0300)]
refresh libusual
Marko Kreen [Wed, 1 Sep 2010 14:31:12 +0000 (17:31 +0300)]
pgqd: allow customizable maintenance
Marko Kreen [Wed, 1 Sep 2010 14:29:24 +0000 (17:29 +0300)]
new function too
Marko Kreen [Wed, 1 Sep 2010 14:28:55 +0000 (17:28 +0300)]
pgq: customizable maintenance functions
Marko Kreen [Tue, 31 Aug 2010 08:55:43 +0000 (11:55 +0300)]
scripts/: conform with new -ini standard.
Each script should define only its own config vars.
Marko Kreen [Tue, 31 Aug 2010 08:55:08 +0000 (11:55 +0300)]
pgqd: switches to signal running process
Marko Kreen [Fri, 25 Jun 2010 11:31:49 +0000 (14:31 +0300)]
Bublin handler.
londiste3 cf.ini add-table foo --handler='bublin(key_column)'
Marko Kreen [Fri, 7 May 2010 12:17:53 +0000 (15:17 +0300)]
Pluggable per-table handlers for event processing.
1. Make handler modules known for Londiste:
[londiste3]
handler_modules = londiste.bublin, some_other.module
Modules are imported and classes found in __londiste_handlers__
module variable are registered.
2. Generic table setup:
londiste3 cf.ini add-table foo --handler='handler1' --handler='handler2(arg1, arg2)'
Londiste standard handler is default and always appended to custom plugins.
Marko Kreen [Mon, 30 Aug 2010 10:48:33 +0000 (13:48 +0300)]
pgq.force_tick: work correctly if ticking is not allowed.
Simply return last tick_id.
Marko Kreen [Mon, 2 Aug 2010 14:10:12 +0000 (17:10 +0300)]
Fix typo.
Marko Kreen [Mon, 2 Aug 2010 11:44:00 +0000 (14:44 +0300)]
Disable use_skylog if non-daemon on console.
This avoids console commands to send errors/warnings to central logging server.
Set use_skylog=2 to always enable.
Marko Kreen [Mon, 2 Aug 2010 11:11:43 +0000 (14:11 +0300)]
DBScript: Wake from sleep on NOTIFY.
Use DBScript .listen(dbname, chan)/.unlisten(dbname, chan) to register.
Marko Kreen [Wed, 28 Jul 2010 13:03:38 +0000 (16:03 +0300)]
doc: install error handling
Marko Kreen [Tue, 27 Jul 2010 11:11:20 +0000 (14:11 +0300)]
Fix manpage deps
Marko Kreen [Tue, 27 Jul 2010 10:41:59 +0000 (13:41 +0300)]
Merge remote branch 'mpihlak/walmgr-dev'
Martin Pihlak [Tue, 27 Jul 2010 08:38:36 +0000 (11:38 +0300)]
Introduce a 'slave_pg_xlog' configuration variable. This
allows master and slave pg_xlog files to be in different
locations. During restore this directory is symlinked to
slave pg_xlog. Patch from Steve Singer.
Martin Pihlak [Tue, 27 Jul 2010 07:54:24 +0000 (10:54 +0300)]
Introduce a 'backup_datadir' configuration variable to
control whether the slave data directory is kept or
overwritten during restore. Patch from Steve Singer.
Martin Pihlak [Tue, 27 Jul 2010 07:54:01 +0000 (10:54 +0300)]
more files to ignore
Martin Pihlak [Tue, 27 Jul 2010 07:33:20 +0000 (10:33 +0300)]
walmgr.py: add --version option
Martin Pihlak [Tue, 27 Jul 2010 07:27:10 +0000 (10:27 +0300)]
Simplify the cleanup logic for partial wals.
Martin Pihlak [Tue, 27 Jul 2010 07:18:35 +0000 (10:18 +0300)]
"walmgr.py sync" now omits unneeded WAL segments if the
database has been cleanly shut down. This greatly reduces
sync time during planned swithcovers as usually there
is only a single WAL file to be synched to slave.
Martin Pihlak [Tue, 27 Jul 2010 07:18:26 +0000 (10:18 +0300)]
more files to ignore
Martin Pihlak [Tue, 27 Jul 2010 06:47:22 +0000 (09:47 +0300)]
Merge branch 'master' of git://github.com/markokr/skytools-dev
Marko Kreen [Mon, 26 Jul 2010 13:01:20 +0000 (16:01 +0300)]
dnscript: avoid .rollback() when closing connection, its unnecessary
Marko Kreen [Wed, 21 Jul 2010 16:02:07 +0000 (19:02 +0300)]
skytools: set_tcp_keepalive()
Separate TCP keepalive code out from connect_database(),
to be usable separately. (Eg. for HTTP connections.)
Add also support for Darwin.
Marko Kreen [Tue, 20 Jul 2010 14:37:25 +0000 (17:37 +0300)]
Configurable suffix support.
Apply suffix also to manpages, SQL and doc directories
Marko Kreen [Tue, 20 Jul 2010 14:34:05 +0000 (17:34 +0300)]
dbstruct: save & restore clustering info
Original patch by André Malo, applied with minor modifications
Marko Kreen [Mon, 19 Jul 2010 11:20:33 +0000 (14:20 +0300)]
skytools: export parse_sqltriga_sql