David E. Wheeler [Wed, 17 Oct 2012 21:49:50 +0000 (14:49 -0700)]
Document `add herd` and `add sync`.
Quite a few questions about some of the parameters to `add sync`, demarcated by `XXX`s.
While at it, add a brief intro discussing options and parameters.
David E. Wheeler [Wed, 17 Oct 2012 19:39:37 +0000 (12:39 -0700)]
Update docs on adding tables and seuences.
David E. Wheeler [Wed, 17 Oct 2012 18:58:41 +0000 (11:58 -0700)]
Start filling out gaps in the docs.
And correcting apparent inaccuracies and modernizing the Pod a bit. This
commit Updates docs through `add db`. Notable changes:
* Remove the bit in the `start` docs about how it restarts Bucardo. The code
does not appear to support that, and the `restart` command seems to have it
covered.
* Remove the "--name" bit from the `start` and `stop` commands. There is no
`--name` option, so I just found it confusing.
* Itemize the types supported by `list` in a Pod list.
* Itemize all the objects supported by `add`.
* Itemize all of the options to `add db`.
Proof-reading for inaccuracie would be greatly appreciated.
David E. Wheeler [Wed, 17 Oct 2012 17:59:42 +0000 (10:59 -0700)]
Stub missing commands in docs.
David E. Wheeler [Wed, 17 Oct 2012 00:02:40 +0000 (17:02 -0700)]
The verb is now split from the noun at line 219.
David E. Wheeler [Tue, 16 Oct 2012 23:47:00 +0000 (16:47 -0700)]
Change default reason_file name to end in .txt.
Because it is not a log file, only the most reason reason is written
to it.
But also modify the rason log file to replace the extension from the reason
file with `.log`. So it should no longer be named
`bucardo.restart.reason.log.log` by default.
In other words, the names are:
Reason File: `bucardo.restart.reason.txt`
Rason Log: `bucardo.restart.reason.log`.
Closes GitHub issue #9.
David E. Wheeler [Tue, 16 Oct 2012 23:30:12 +0000 (16:30 -0700)]
Move the reason file to the debug directory.
Which is `.` by default, so in the default case, it will be the same as the
current behavior. Ref: GitHub Issue #9.
David E. Wheeler [Tue, 16 Oct 2012 23:18:01 +0000 (16:18 -0700)]
Skip the .init and .spec files.
They are not Perl. Maybe distribution-related stuff should go into another directory? `dist` perhaps?
David E. Wheeler [Tue, 16 Oct 2012 23:11:55 +0000 (16:11 -0700)]
Add --exit-on-nosync option.
And change the default so that, if there are no active syncs, by default
bucardo will *not* exit. Pass this option to make it exit anyway. Per
discussion; Closes #8
David E. Wheeler [Tue, 16 Oct 2012 22:51:09 +0000 (15:51 -0700)]
Move all but two blocker to-dos to GitHub issues.
They are still here, but now with links to GitHub. Could not find the post reporting the bug that checks the wrong tables, so I did not add that one. The other one I did not add was answering all mail list messages.
David E. Wheeler [Tue, 2 Oct 2012 22:08:21 +0000 (15:08 -0700)]
Add a Linux init script and RPM spec file.
The latter is forked from Devrim's pgrpms spec file.
David E. Wheeler [Mon, 1 Oct 2012 22:59:43 +0000 (15:59 -0700)]
Add chkconfig support to the start script.
Greg Sabino Mullane [Sun, 30 Sep 2012 03:50:10 +0000 (23:50 -0400)]
Clean up TODO, add some links.
Greg Sabino Mullane [Sat, 29 Sep 2012 03:02:25 +0000 (23:02 -0400)]
Workarounds for empty primary key join/split problem found by Bill on mailing list.
Greg Sabino Mullane [Sat, 29 Sep 2012 03:01:39 +0000 (23:01 -0400)]
Remove debug detritus.
Greg Sabino Mullane [Thu, 27 Sep 2012 13:03:59 +0000 (09:03 -0400)]
Change PGIN to IN; consolidate flat and flatpg modes for now.
Rosser Schwarz [Thu, 27 Sep 2012 07:04:00 +0000 (00:04 -0700)]
and another.
Rosser Schwarz [Thu, 27 Sep 2012 07:02:50 +0000 (00:02 -0700)]
oops. missed a spot.
Rosser Schwarz [Wed, 26 Sep 2012 04:25:24 +0000 (21:25 -0700)]
consolidating IN and PGIN blocks in delete_rows
Greg Sabino Mullane [Wed, 26 Sep 2012 03:45:37 +0000 (23:45 -0400)]
Prevent empty trailing items from being ignored when doing a split, especially for the list of primary keys. This should fix a problem reported on the mailing list giving the error "arguments of row IN must all be row expressions"
Greg Sabino Mullane [Fri, 21 Sep 2012 20:45:28 +0000 (16:45 -0400)]
Quick TODO additions
Greg Sabino Mullane [Fri, 21 Sep 2012 20:15:34 +0000 (16:15 -0400)]
Since we use MAX(), and the table may have no rows, we need to handle getting back a null, which means that $epoch may be undefined.
Greg Sabino Mullane [Thu, 20 Sep 2012 20:38:44 +0000 (16:38 -0400)]
Fix some syntax and other problems; simple tests now show 8.1 works as a valid target database.
Greg Sabino Mullane [Thu, 20 Sep 2012 20:27:37 +0000 (16:27 -0400)]
Force time zone to uppercase GMT for old servers.
Greg Sabino Mullane [Fri, 14 Sep 2012 17:29:31 +0000 (13:29 -0400)]
Check for cases in which the sync column of bucardo_delta_targets does not exist when doing validate_sync.
Greg Sabino Mullane [Wed, 12 Sep 2012 22:13:39 +0000 (18:13 -0400)]
Add a single apostrophe to text values for additional quoting checks.
David E. Wheeler [Wed, 12 Sep 2012 22:12:01 +0000 (15:12 -0700)]
Report proper test failure context.
Added a few of these lines to BucardoTesting.pm:
local $Test::Builder::Level = $Test::Builder::Level + 1;
Because otherwise, Test::Builder reports the failure from the function or
method call in BucardoTesting.pm, rather than the calling `*.t` file. This
will make it easier to find the file and line of the actual test failure.
David E. Wheeler [Wed, 12 Sep 2012 21:55:47 +0000 (14:55 -0700)]
Add databas now works with the same parameters.
Greg says, via IRC, "We now allow that, for cool in-place table trimming." So
it seems as though the tests for it should be updated. And so they now are.
David E. Wheeler [Wed, 12 Sep 2012 21:41:30 +0000 (14:41 -0700)]
The pg_stat_activity PID column name has changed on 9.2.
So detect if we're on 9.2 or higher, and use the new name, `pid`. Still use
the old name, `procpid`, for older versions of PostgreSQL.
David E. Wheeler [Wed, 12 Sep 2012 21:22:40 +0000 (14:22 -0700)]
Turn list of prereqs into a Pod list and add boolean.
David E. Wheeler [Wed, 12 Sep 2012 21:14:56 +0000 (14:14 -0700)]
Report reason for compile failure.
Greg Sabino Mullane [Thu, 30 Aug 2012 18:22:31 +0000 (14:22 -0400)]
Tests for same-database
Greg Sabino Mullane [Thu, 23 Aug 2012 15:00:00 +0000 (11:00 -0400)]
Allow databases to have the same dsn, as we are moving towards in-database replication.
Greg Sabino Mullane [Thu, 23 Aug 2012 14:34:57 +0000 (10:34 -0400)]
Testing tweaks
Greg Sabino Mullane [Thu, 19 Jul 2012 11:29:27 +0000 (07:29 -0400)]
Note recent bug
Greg Sabino Mullane [Thu, 31 May 2012 17:40:16 +0000 (13:40 -0400)]
New siganture for 4.99.5
Greg Sabino Mullane [Thu, 31 May 2012 17:39:54 +0000 (13:39 -0400)]
Update MANIFEST
Greg Sabino Mullane [Thu, 31 May 2012 17:36:59 +0000 (13:36 -0400)]
Bump to version 4.99.5: get ready for next beta
Greg Sabino Mullane [Mon, 21 May 2012 16:50:08 +0000 (12:50 -0400)]
Minor sprintf fix to bucardo
Greg Sabino Mullane [Thu, 10 May 2012 19:39:33 +0000 (15:39 -0400)]
We have column names with underscores, thank you very much.
Ali Asad Lotia [Wed, 9 May 2012 20:56:39 +0000 (16:56 -0400)]
Make the summary usage message more consistent with the man page.
Items are listed in similar order on both pages. Additionally,
customname, customcols and customcode are mentioned in the usage
message. Finally the usage information for customname, customcols
and customcode are added to the man page.
Greg Sabino Mullane [Wed, 9 May 2012 00:02:09 +0000 (20:02 -0400)]
Testing tweaks.
Greg Sabino Mullane [Tue, 8 May 2012 20:30:52 +0000 (16:30 -0400)]
Switch back to Redis, as Redis::Client does not die smoothly on connection errors.
Greg Sabino Mullane [Tue, 8 May 2012 20:01:37 +0000 (16:01 -0400)]
Make sure we remove the tschema test schema in our tests.
Greg Sabino Mullane [Tue, 8 May 2012 19:47:25 +0000 (15:47 -0400)]
Allow spaces in customnames
Greg Sabino Mullane [Tue, 8 May 2012 19:46:57 +0000 (15:46 -0400)]
Tentative support for multi-column primary keys in MongoDB
Greg Sabino Mullane [Mon, 30 Apr 2012 14:15:54 +0000 (10:15 -0400)]
Changes file cleanups
Ali Asad Lotia [Mon, 30 Apr 2012 14:12:02 +0000 (10:12 -0400)]
Do not map NULL values to Mongo but simply drop them, as MongoDB is schemaless.
Greg Sabino Mullane [Sun, 29 Apr 2012 19:00:02 +0000 (15:00 -0400)]
Quick inline notes on how to handle common data mismatch problem.
Greg Sabino Mullane [Sun, 29 Apr 2012 03:37:46 +0000 (23:37 -0400)]
Chunk up the MongoDB deletes so as not to overwhelm the server on large tables.
May still require changing statement_chunk_size
Ed Snajder [Sun, 29 Apr 2012 02:38:50 +0000 (22:38 -0400)]
Should be setting, not value
Greg Sabino Mullane [Sun, 29 Apr 2012 02:12:40 +0000 (22:12 -0400)]
Better lookup for old bucardo_sequence tables.
Per mailing list question from Ed Snajder
Greg Sabino Mullane [Sat, 28 Apr 2012 23:59:31 +0000 (19:59 -0400)]
Credit last change.
Christian Recktenwald [Sat, 28 Apr 2012 23:58:14 +0000 (19:58 -0400)]
Add 'bucardo list all' to list everything at once.
Greg Sabino Mullane [Mon, 23 Apr 2012 19:27:25 +0000 (15:27 -0400)]
Add "one logfile per sync" idea from the ML.
Greg Sabino Mullane [Wed, 18 Apr 2012 15:18:05 +0000 (11:18 -0400)]
Fix up table names now that we are capping test3
Greg Sabino Mullane [Wed, 18 Apr 2012 14:07:38 +0000 (10:07 -0400)]
Try again for a unique var name
Greg Sabino Mullane [Tue, 17 Apr 2012 22:04:45 +0000 (18:04 -0400)]
Don't use variable names when a column name already exists - some versions of plpgsql will get confused.
Greg Sabino Mullane [Mon, 2 Apr 2012 16:45:34 +0000 (12:45 -0400)]
Show full name of relation when giving deadlock details. Fix missing comma.
Greg Sabino Mullane [Tue, 27 Mar 2012 21:19:13 +0000 (17:19 -0400)]
Spellcheck tweaks
Greg Sabino Mullane [Tue, 27 Mar 2012 20:28:15 +0000 (16:28 -0400)]
Finish up the Redis work, including a new test.
Also switch from the Redis Perl driver the Redis::Client, as the latter has hash support.
Greg Sabino Mullane [Tue, 27 Mar 2012 20:26:36 +0000 (16:26 -0400)]
Minor typos.
Greg Sabino Mullane [Fri, 23 Mar 2012 16:30:25 +0000 (12:30 -0400)]
Minor TODO updates.
Greg Sabino Mullane [Thu, 22 Mar 2012 19:58:15 +0000 (15:58 -0400)]
Add support for MariaDB
Greg Sabino Mullane [Thu, 22 Mar 2012 18:38:21 +0000 (14:38 -0400)]
Testing tweaks for SQLite
Greg Sabino Mullane [Thu, 22 Mar 2012 18:32:54 +0000 (14:32 -0400)]
No backticks!
Greg Sabino Mullane [Thu, 22 Mar 2012 18:28:36 +0000 (14:28 -0400)]
Typo help.
Greg Sabino Mullane [Thu, 22 Mar 2012 18:28:21 +0000 (14:28 -0400)]
Update testing suite for MySQL.
Greg Sabino Mullane [Wed, 21 Mar 2012 18:08:12 +0000 (14:08 -0400)]
Adjust for case-sensitive table names in testing.
Greg Sabino Mullane [Sun, 18 Mar 2012 20:38:57 +0000 (16:38 -0400)]
Various small tweaks.
Greg Sabino Mullane [Sun, 18 Mar 2012 12:45:21 +0000 (08:45 -0400)]
Cleanup of conflict code
Greg Sabino Mullane [Sun, 18 Mar 2012 12:42:34 +0000 (08:42 -0400)]
Lower default sleeps; making testing too painful. :)
Greg Sabino Mullane [Sun, 18 Mar 2012 12:42:23 +0000 (08:42 -0400)]
Expand test coverage.
Greg Sabino Mullane [Sun, 18 Mar 2012 12:41:50 +0000 (08:41 -0400)]
Remove unused sub. Better debug output during testing.
Greg Sabino Mullane [Fri, 16 Mar 2012 17:41:09 +0000 (13:41 -0400)]
Sleep a bit after we fork the VAC daemon, to decrease the chances of things blowing up if the MCP dies before we call inactivedestroy on the forked handles.
Greg Sabino Mullane [Fri, 16 Mar 2012 03:17:41 +0000 (23:17 -0400)]
Better checking of "identical" default column expressions.
Greg Sabino Mullane [Wed, 14 Mar 2012 12:58:00 +0000 (08:58 -0400)]
There are some other related issues, but might as well fix this up in a commit.
Greg Sabino Mullane [Thu, 8 Mar 2012 20:44:46 +0000 (15:44 -0500)]
Allow timestamp columns to not match on startup.
Greg Sabino Mullane [Thu, 8 Mar 2012 20:41:09 +0000 (15:41 -0500)]
Fix up quoting of tablenames.
Redo the truncate support.
Test with mixed-case tablenames.
Greg Sabino Mullane [Fri, 2 Mar 2012 19:35:54 +0000 (14:35 -0500)]
Test counting tweaks.
Greg Sabino Mullane [Fri, 2 Mar 2012 04:47:41 +0000 (23:47 -0500)]
Sequence testing.
Greg Sabino Mullane [Fri, 2 Mar 2012 04:47:13 +0000 (23:47 -0500)]
Fixes for sequences
Greg Sabino Mullane [Tue, 28 Feb 2012 15:27:27 +0000 (10:27 -0500)]
Add tests for sequences.
Greg Sabino Mullane [Tue, 28 Feb 2012 15:09:00 +0000 (10:09 -0500)]
Do not show "old" sequence information if this is a fullcopy, as we are simply blowing it away.
Greg Sabino Mullane [Tue, 28 Feb 2012 14:56:07 +0000 (09:56 -0500)]
Make it easier to add sequences to a herd
Greg Sabino Mullane [Tue, 28 Feb 2012 13:39:38 +0000 (08:39 -0500)]
Testing infra: detect sequence diffs.
Greg Sabino Mullane [Mon, 27 Feb 2012 21:31:36 +0000 (16:31 -0500)]
More support for my horrible typing skills.
Greg Sabino Mullane [Mon, 27 Feb 2012 21:15:46 +0000 (16:15 -0500)]
Remove debug message.
Greg Sabino Mullane [Mon, 27 Feb 2012 21:15:15 +0000 (16:15 -0500)]
Testing cleanups.
Greg Sabino Mullane [Mon, 27 Feb 2012 12:47:25 +0000 (07:47 -0500)]
Better summary output.
Greg Sabino Mullane [Mon, 27 Feb 2012 12:37:01 +0000 (07:37 -0500)]
More support for non-standard table names.h
Greg Sabino Mullane [Sun, 26 Feb 2012 13:11:22 +0000 (08:11 -0500)]
Add table with a space to the tests, small adjustments so such tables work.
Greg Sabino Mullane [Sun, 26 Feb 2012 00:36:11 +0000 (19:36 -0500)]
Cleanup the fullcopy test, and refactor things into BucardoTesting.pm
Greg Sabino Mullane [Sat, 25 Feb 2012 05:31:01 +0000 (00:31 -0500)]
More fullcopy/onetimecopy changes.
Greg Sabino Mullane [Sat, 25 Feb 2012 05:30:33 +0000 (00:30 -0500)]
Messages cleaning
Greg Sabino Mullane [Sat, 25 Feb 2012 04:48:02 +0000 (23:48 -0500)]
More cleanup of the fullcopy/onetimecopy system.
Greg Sabino Mullane [Fri, 24 Feb 2012 19:15:52 +0000 (14:15 -0500)]
Still on the fence about repeatable read vs serializable, but let's aim for less deadlocks with some slight overhead for the true serializability. See my blog post for more :)
Greg Sabino Mullane [Fri, 24 Feb 2012 17:45:29 +0000 (12:45 -0500)]
Show if a sync is fullcopy or not
Greg Sabino Mullane [Fri, 24 Feb 2012 17:42:39 +0000 (12:42 -0500)]
Only run the VAC daemon if we have eligible databases.
Greg Sabino Mullane [Fri, 24 Feb 2012 13:34:50 +0000 (08:34 -0500)]
Fix typo regarding piddir