skytools.git
14 years agopgq.ticker(): rework the old tick sanity check
Marko Kreen [Fri, 14 Jan 2011 12:09:47 +0000 (14:09 +0200)]
pgq.ticker(): rework the old tick sanity check

due to good-enough timing, seq and xmax may appear reversed.

only error out when xmin is wrong.

otherwise throw warning, to debug the issue.

14 years agofixed case when event id is NULL on retry
Asko Tiidumaa [Fri, 14 Jan 2011 12:01:20 +0000 (12:01 +0000)]
fixed case when event id is NULL on retry

14 years agoMerge remote branch 'mpihlak/master'
Marko Kreen [Thu, 13 Jan 2011 13:58:56 +0000 (15:58 +0200)]
Merge remote branch 'mpihlak/master'

14 years agoFix "walmgr stop" not to disable archive_mode.
Martin Pihlak [Thu, 13 Jan 2011 13:31:03 +0000 (15:31 +0200)]
Fix "walmgr stop" not to disable archive_mode.

That is, unless master_restart_cmd is defined.

14 years agotests/londiste: test lagging takeover
Marko Kreen [Wed, 12 Jan 2011 13:59:34 +0000 (15:59 +0200)]
tests/londiste: test lagging takeover

14 years agonodeinfo status: show only first line of error
Marko Kreen [Wed, 12 Jan 2011 13:54:04 +0000 (15:54 +0200)]
nodeinfo status: show only first line of error

14 years agodoc/devnotes: point to new repo
Marko Kreen [Wed, 12 Jan 2011 13:53:38 +0000 (15:53 +0200)]
doc/devnotes: point to new repo

14 years agorefresh libusual
Marko Kreen [Mon, 10 Jan 2011 14:33:28 +0000 (16:33 +0200)]
refresh libusual

14 years agotests: default to tcp connection
Marko Kreen [Mon, 10 Jan 2011 14:32:24 +0000 (16:32 +0200)]
tests: default to tcp connection

14 years agocascadedworker: create ticks on branch in separate tx
Marko Kreen [Mon, 10 Jan 2011 14:30:30 +0000 (16:30 +0200)]
cascadedworker: create ticks on branch in separate tx

txid_visible_in_snapshot() does not consider same txid
as visible in current snapshot.

14 years agotests/londiste: generate some load when testing
Marko Kreen [Mon, 10 Jan 2011 14:28:04 +0000 (16:28 +0200)]
tests/londiste: generate some load when testing

14 years agopgq/triggers: disallow primary key updates
Marko Kreen [Mon, 10 Jan 2011 14:27:03 +0000 (16:27 +0200)]
pgq/triggers: disallow primary key updates

14 years agopgq.ticker: better error message when sanity check fails
Marko Kreen [Mon, 10 Jan 2011 14:26:05 +0000 (16:26 +0200)]
pgq.ticker: better error message when sanity check fails

14 years agoMerge branch 'master' of internal-git:/git/dba/skytools-3
Asko Tiidumaa [Wed, 22 Dec 2010 09:30:21 +0000 (09:30 +0000)]
Merge branch 'master' of internal-git:/git/dba/skytools-3

14 years agofixes to producer sql filtering
Asko Tiidumaa [Wed, 22 Dec 2010 09:29:51 +0000 (09:29 +0000)]
fixes to producer sql filtering

14 years agoupdate syslog settings in pgqd.ini
Martin Pihlak [Wed, 22 Dec 2010 09:06:50 +0000 (11:06 +0200)]
update syslog settings in pgqd.ini

14 years agochange default syslog=1 for pgqd.
Martin Pihlak [Wed, 22 Dec 2010 08:56:19 +0000 (10:56 +0200)]
change default syslog=1 for pgqd.

14 years agoMerge remote branch 'intgit/master'
Marko Kreen [Tue, 21 Dec 2010 12:39:47 +0000 (14:39 +0200)]
Merge remote branch 'intgit/master'

14 years agolambda vs quite_literal
Asko Tiidumaa [Tue, 21 Dec 2010 12:37:52 +0000 (12:37 +0000)]
lambda vs quite_literal

14 years agofixed local_only functionality, structural changes
Asko Tiidumaa [Mon, 20 Dec 2010 18:22:48 +0000 (18:22 +0000)]
fixed local_only functionality, structural changes

14 years agoadded local_only to londiste config parameter - accepts only events for local tables
Asko Tiidumaa [Mon, 20 Dec 2010 16:57:38 +0000 (16:57 +0000)]
added local_only to londiste config parameter - accepts only events for local tables

14 years agoqaadmin: unquote_literal fix
Marko Kreen [Thu, 16 Dec 2010 13:46:00 +0000 (15:46 +0200)]
qaadmin: unquote_literal fix

14 years agolondiste add: create_flags must be 0 by default
Marko Kreen [Tue, 14 Dec 2010 13:16:48 +0000 (15:16 +0200)]
londiste add: create_flags must be 0 by default

14 years agobump db ver
Marko Kreen [Tue, 14 Dec 2010 12:54:51 +0000 (14:54 +0200)]
bump db ver

14 years agopgq_node: workarounds for bandaid casts
Marko Kreen [Tue, 14 Dec 2010 12:51:21 +0000 (14:51 +0200)]
pgq_node: workarounds for bandaid casts

14 years agopgq: avoid text||int concet, it breaks if db has bandaid casts installed
Marko Kreen [Tue, 14 Dec 2010 12:48:19 +0000 (14:48 +0200)]
pgq: avoid text||int concet, it breaks if db has bandaid casts installed

14 years agolondiste add-table: dont set create_flags prematurely
Marko Kreen [Tue, 14 Dec 2010 12:24:08 +0000 (14:24 +0200)]
londiste add-table: dont set create_flags prematurely

14 years agobump db ver
Marko Kreen [Mon, 13 Dec 2010 08:34:20 +0000 (10:34 +0200)]
bump db ver

14 years agoMerge remote branch 'askotm/master'
Marko Kreen [Mon, 13 Dec 2010 08:02:35 +0000 (10:02 +0200)]
Merge remote branch 'askotm/master'

14 years agofix pg_autovacuum defaults in pgq.tune_storage()
Martin Pihlak [Sun, 12 Dec 2010 13:34:00 +0000 (15:34 +0200)]
fix pg_autovacuum defaults in pgq.tune_storage()

Previous version used zero value for freeze_max_age, which caused
autovacuum to constantly re-vacuum all of the event tables because
of the wraparound threat. Set this and other values to -1 to indicate
system default.

14 years agofixed two typos
Asko Tiidumaa [Thu, 9 Dec 2010 16:27:42 +0000 (16:27 +0000)]
fixed two typos

14 years agowrote handle_fkeys to more gp-friendlier version
Asko Tiidumaa [Thu, 9 Dec 2010 16:25:33 +0000 (16:25 +0000)]
wrote handle_fkeys to more gp-friendlier version

14 years agoCosmetics for wal-master.ini + hot_standby support.
Martin Pihlak [Thu, 9 Dec 2010 15:34:03 +0000 (17:34 +0200)]
Cosmetics for wal-ini + hot_standby support.

14 years agoAllow "primary_conninfo" to be specified in wal-slave.ini
Martin Pihlak [Thu, 9 Dec 2010 15:32:58 +0000 (17:32 +0200)]
Allow "primary_conninfo" to be specified in wal-slave.ini

Based on a patch by Mark Kirkwood.

14 years agoSome adjustments for 9.0, wal_level GUC is also modified during setup/stop.
Martin Pihlak [Thu, 9 Dec 2010 15:32:00 +0000 (17:32 +0200)]
Some adjustments for 9.0, wal_level GUC is also modified during setup/stop.

14 years agodbstruct: use new acl parser
Marko Kreen [Wed, 8 Dec 2010 14:39:37 +0000 (16:39 +0200)]
dbstruct: use new acl parser

14 years agoqadmin: remove exception test
Marko Kreen [Wed, 8 Dec 2010 14:37:28 +0000 (16:37 +0200)]
qadmin: remove exception test

14 years agoskytools: parse_acl() func for postgres ACL parsing
Marko Kreen [Wed, 8 Dec 2010 14:33:22 +0000 (16:33 +0200)]
skytools: parse_acl() func for postgres ACL parsing

14 years agolondiste tables: dont show non-local tables
Marko Kreen [Wed, 8 Dec 2010 14:11:50 +0000 (16:11 +0200)]
londiste tables: dont show non-local tables

those can be seen with 'missing'

14 years agoqadmin: catch and show python exceptions
Marko Kreen [Wed, 8 Dec 2010 13:59:04 +0000 (15:59 +0200)]
qadmin: catch and show python exceptions

14 years agolondiste do-sync: actually reset the pgq params
Marko Kreen [Wed, 8 Dec 2010 13:58:36 +0000 (15:58 +0200)]
londiste do-sync: actually reset the pgq params

14 years agotick logic now respects either lag or max tick count, not just both
Asko Tiidumaa [Wed, 8 Dec 2010 13:42:21 +0000 (13:42 +0000)]
tick logic now respects either lag or max tick count, not just both

14 years agopgq_node.version: 3.0.0.4
Marko Kreen [Wed, 8 Dec 2010 12:47:21 +0000 (14:47 +0200)]
pgq_node.version: 3.0.0.4

14 years agoskytools.unquote_ident: dont crash on empty string
Marko Kreen [Wed, 8 Dec 2010 12:45:58 +0000 (14:45 +0200)]
skytools.unquote_ident: dont crash on empty string

14 years agolondiste: force small batches for do-sync
Marko Kreen [Wed, 8 Dec 2010 12:44:57 +0000 (14:44 +0200)]
londiste: force small batches for do-sync

14 years agopgq_node.get_consumer_state: missing returns, update regtest
Marko Kreen [Wed, 8 Dec 2010 12:44:07 +0000 (14:44 +0200)]
pgq_node.get_consumer_state: missing returns, update regtest

14 years agolondiste.playback: unused tablestate method
Marko Kreen [Wed, 8 Dec 2010 12:39:32 +0000 (14:39 +0200)]
londiste.playback: unused tablestate method

14 years agosplit query to avoid gp errors
Asko Tiidumaa [Wed, 8 Dec 2010 11:09:10 +0000 (11:09 +0000)]
split query to avoid gp errors

14 years agolondiste: load bulkloader by default
Marko Kreen [Mon, 6 Dec 2010 12:53:14 +0000 (14:53 +0200)]
londiste: load bulkloader by default

14 years agobulkloader: better error message if wrong event type
Marko Kreen [Mon, 6 Dec 2010 12:47:50 +0000 (14:47 +0200)]
bulkloader: better error message if wrong event type

14 years agoqadmin: sql passthrough, show table/sequence, cleanups
Marko Kreen [Mon, 6 Dec 2010 12:47:00 +0000 (14:47 +0200)]
qadmin: sql passthrough, show table/sequence, cleanups

14 years agodbstruct: slightly more readable SQL output
Marko Kreen [Mon, 6 Dec 2010 12:17:52 +0000 (14:17 +0200)]
dbstruct: slightly more readable SQL output

14 years agoquote_ident: special-case empty string
Marko Kreen [Mon, 6 Dec 2010 12:17:19 +0000 (14:17 +0200)]
quote_ident: special-case empty string

14 years agosql_tokenize: various improvements
Marko Kreen [Mon, 6 Dec 2010 12:14:04 +0000 (14:14 +0200)]
sql_tokenize: various improvements

- drop the use_qident param, wrong place for it
- support multi-symbol operators
- support >2 parts in names
- drop the magic escaping in pynew,pyold.  it does not make sense
- let all unknown symbols count as error

14 years agoqadmin: parser cleanup
Marko Kreen [Fri, 3 Dec 2010 15:27:33 +0000 (17:27 +0200)]
qadmin: parser cleanup

14 years agotodo update
Marko Kreen [Fri, 3 Dec 2010 15:27:12 +0000 (17:27 +0200)]
todo update

14 years agobulkloader doc: show correct londiste switch
Marko Kreen [Fri, 3 Dec 2010 15:26:43 +0000 (17:26 +0200)]
bulkloader doc: show correct londiste switch

14 years agosql_tokenizer: options to returns quoted idents separately
Marko Kreen [Fri, 3 Dec 2010 15:26:10 +0000 (17:26 +0200)]
sql_tokenizer: options to returns quoted idents separately

14 years agotests/handler: bulk handler test
Marko Kreen [Fri, 3 Dec 2010 13:53:51 +0000 (15:53 +0200)]
tests/handler: bulk handler test

14 years agolondiste handler: convert bulkloader to handler
Marko Kreen [Fri, 3 Dec 2010 13:50:03 +0000 (15:50 +0200)]
londiste handler: convert bulkloader to handler

14 years agomagic_insert: allow pre-quoted table name
Marko Kreen [Fri, 3 Dec 2010 13:49:32 +0000 (15:49 +0200)]
magic_insert: allow pre-quoted table name

14 years agorefresh libusual
Marko Kreen [Fri, 3 Dec 2010 12:22:30 +0000 (14:22 +0200)]
refresh libusual

14 years agolondiste playback: fix cursor name
Marko Kreen [Fri, 3 Dec 2010 12:14:08 +0000 (14:14 +0200)]
londiste playback: fix cursor name

14 years agocascadedworker: missing import
Marko Kreen [Fri, 3 Dec 2010 12:13:26 +0000 (14:13 +0200)]
cascadedworker: missing import

14 years agosql/londiste: actually install the .version function
Marko Kreen [Fri, 3 Dec 2010 12:12:59 +0000 (14:12 +0200)]
sql/londiste: actually install the .version function

14 years agolondiste.version(): 3.0.0.6
Marko Kreen [Fri, 3 Dec 2010 09:16:29 +0000 (11:16 +0200)]
londiste.version(): 3.0.0.6

14 years agolondiste copy: at do-sync time disable large batches
Marko Kreen [Fri, 3 Dec 2010 09:15:37 +0000 (11:15 +0200)]
londiste copy: at do-sync time disable large batches

14 years agolondiste.local_add_table: avoid assigning to IN param
Marko Kreen [Fri, 3 Dec 2010 09:02:31 +0000 (11:02 +0200)]
londiste.local_add_table: avoid assigning to IN param

14 years agolondiste.version(): 3.0.0.5
Marko Kreen [Thu, 2 Dec 2010 14:39:23 +0000 (16:39 +0200)]
londiste.version(): 3.0.0.5

14 years agodoc: ignore rsync errors
Marko Kreen [Thu, 2 Dec 2010 14:29:50 +0000 (16:29 +0200)]
doc: ignore rsync errors

14 years agoqadmin: fancier lodiste add_table
Marko Kreen [Thu, 2 Dec 2010 13:46:19 +0000 (15:46 +0200)]
qadmin: fancier lodiste add_table

14 years agolondiste: --no-triggers arg
Marko Kreen [Thu, 2 Dec 2010 13:45:15 +0000 (15:45 +0200)]
londiste: --no-triggers arg

14 years agolondiste.local_add_table: no_triggers and expect_sync magic args
Marko Kreen [Thu, 2 Dec 2010 13:39:50 +0000 (15:39 +0200)]
londiste.local_add_table: no_triggers and expect_sync magic args

15 years agolondiste.version(): 3.0.0.4
Marko Kreen [Wed, 1 Dec 2010 13:25:13 +0000 (15:25 +0200)]
londiste.version(): 3.0.0.4

15 years agotests/londiste: test table-remove on subscribers
Marko Kreen [Wed, 1 Dec 2010 13:21:01 +0000 (15:21 +0200)]
tests/londiste: test table-remove on subscribers

15 years agolondiste: show table counts in 'status'
Marko Kreen [Wed, 1 Dec 2010 13:20:38 +0000 (15:20 +0200)]
londiste: show table counts in 'status'

15 years agosql/londiste: create deny-trigger on leaf
Marko Kreen [Wed, 1 Dec 2010 13:19:34 +0000 (15:19 +0200)]
sql/londiste: create deny-trigger on leaf

15 years agolondiste tests: sync with trigger fmt changes
Marko Kreen [Wed, 1 Dec 2010 13:19:00 +0000 (15:19 +0200)]
londiste tests: sync with trigger fmt changes

15 years agopgq/triggers: 'deny' argument to logutriga/sqltriga
Marko Kreen [Wed, 1 Dec 2010 13:06:12 +0000 (15:06 +0200)]
pgq/triggers: 'deny' argument to logutriga/sqltriga

Needed for deny trigger on leafs.

15 years agolondiste.drop_table_triggers: check whether trigger has args
Marko Kreen [Tue, 30 Nov 2010 13:28:42 +0000 (15:28 +0200)]
londiste.drop_table_triggers: check whether trigger has args

15 years agolondiste.local_add_table: typo fix in 8.3 branch
Marko Kreen [Tue, 30 Nov 2010 13:28:17 +0000 (15:28 +0200)]
londiste.local_add_table: typo fix in 8.3 branch

15 years agorefresh libusual
Marko Kreen [Tue, 30 Nov 2010 13:03:01 +0000 (15:03 +0200)]
refresh libusual

15 years agolondiste.local_add_table: avoid array_length(), its 8.4+
Marko Kreen [Tue, 30 Nov 2010 13:00:02 +0000 (15:00 +0200)]
londiste.local_add_table: avoid array_length(), its 8.4+

15 years agotests/merge: make sync faster
Marko Kreen [Mon, 29 Nov 2010 14:39:49 +0000 (16:39 +0200)]
tests/merge: make sync faster

15 years agolondiste: use pgq.logutriga() as default trigger function
Marko Kreen [Mon, 29 Nov 2010 14:33:21 +0000 (16:33 +0200)]
londiste: use pgq.logutriga() as default trigger function

15 years agotests/merge: wait for sync on combined-root
Marko Kreen [Mon, 29 Nov 2010 14:29:14 +0000 (16:29 +0200)]
tests/merge: wait for sync on combined-root

15 years agolondiste.local_add_table: use --expect-sync on leaf to combined-branch
Marko Kreen [Mon, 29 Nov 2010 14:28:28 +0000 (16:28 +0200)]
londiste.local_add_table: use --expect-sync on leaf to combined-branch

15 years agoset db ver for 3.0.0.3
Marko Kreen [Mon, 29 Nov 2010 13:02:25 +0000 (15:02 +0200)]
set db ver for 3.0.0.3

15 years agoAllow optional use of libevent
Marko Kreen [Mon, 29 Nov 2010 12:44:31 +0000 (14:44 +0200)]
Allow optional use of libevent

15 years agorefresh libevent
Marko Kreen [Mon, 29 Nov 2010 12:44:19 +0000 (14:44 +0200)]
refresh libevent

15 years agoCascadedWorker: merge-leaf must not write to db on branch
Marko Kreen [Mon, 29 Nov 2010 12:43:43 +0000 (14:43 +0200)]
CascadedWorker: merge-leaf must not write to db on branch

15 years agosql/*: Simplify queries to be able to run greenplum as leaf
Asko Tiidumaa [Fri, 26 Nov 2010 12:33:33 +0000 (12:33 +0000)]
sql/*: Simplify queries to be able to run greenplum as leaf

execute:
  Move session_replication_role setting out of db functions.

15 years agopgq.consumer: rename next_batch_custom result fields
Marko Kreen [Fri, 26 Nov 2010 13:05:25 +0000 (15:05 +0200)]
pgq.consumer: rename next_batch_custom result fields

fields names are out-of-sync with get_batch_info()..

15 years agolondiste.local_add_table: skip empty arg array
Marko Kreen [Fri, 26 Nov 2010 11:51:59 +0000 (13:51 +0200)]
londiste.local_add_table: skip empty arg array

15 years agoremove duplicate batch_info setting
Marko Kreen [Fri, 26 Nov 2010 11:32:34 +0000 (13:32 +0200)]
remove duplicate batch_info setting

15 years agolondiste.handlers: separate package for handlers
Marko Kreen [Fri, 19 Nov 2010 13:19:05 +0000 (15:19 +0200)]
londiste.handlers: separate package for handlers

15 years agolondiste: call handler at add-table time
Marko Kreen [Fri, 19 Nov 2010 13:17:51 +0000 (15:17 +0200)]
londiste: call handler at add-table time

15 years agolondiste: some handler fixes
Marko Kreen [Fri, 19 Nov 2010 13:17:27 +0000 (15:17 +0200)]
londiste: some handler fixes

15 years agogitignore: add debian crap
Marko Kreen [Fri, 19 Nov 2010 13:23:27 +0000 (15:23 +0200)]
gitignore: add debian crap

15 years agolondiste: trigger flags to control trigger creation
Marko Kreen [Fri, 12 Nov 2010 14:20:40 +0000 (16:20 +0200)]
londiste: trigger flags to control trigger creation