bucardo.git
13 years agoDocument `add herd` and `add sync`.
David E. Wheeler [Wed, 17 Oct 2012 21:49:50 +0000 (14:49 -0700)]
Document `add herd` and `add sync`.

Quite a few questions about some of the parameters to `add sync`, demarcated by `XXX`s.

While at it, add a brief intro discussing options and parameters.

13 years agoUpdate docs on adding tables and seuences.
David E. Wheeler [Wed, 17 Oct 2012 19:39:37 +0000 (12:39 -0700)]
Update docs on adding tables and seuences.

13 years agoStart filling out gaps in the docs.
David E. Wheeler [Wed, 17 Oct 2012 18:58:41 +0000 (11:58 -0700)]
Start filling out gaps in the docs.

And correcting apparent inaccuracies and modernizing the Pod a bit. This
commit Updates docs through `add db`. Notable changes:

* Remove the bit in the `start` docs about how it restarts Bucardo. The code
  does not appear to support that, and the `restart` command seems to have it
  covered.
* Remove the "--name" bit from the `start` and `stop` commands. There is no
  `--name` option, so I just found it confusing.
* Itemize the types supported by `list` in a Pod list.
* Itemize all the objects supported by `add`.
* Itemize all of the options to `add db`.

Proof-reading for inaccuracie would be greatly appreciated.

13 years agoStub missing commands in docs.
David E. Wheeler [Wed, 17 Oct 2012 17:59:42 +0000 (10:59 -0700)]
Stub missing commands in docs.

13 years agoThe verb is now split from the noun at line 219.
David E. Wheeler [Wed, 17 Oct 2012 00:02:40 +0000 (17:02 -0700)]
The verb is now split from the noun at line 219.

13 years agoChange default reason_file name to end in .txt.
David E. Wheeler [Tue, 16 Oct 2012 23:47:00 +0000 (16:47 -0700)]
Change default reason_file name to end in .txt.

Because it is not a log file, only the most reason reason is written
to it.

But also modify the rason log file to replace the extension from the reason
file with `.log`. So it should no longer be named
`bucardo.restart.reason.log.log` by default.

In other words, the names are:

Reason File: `bucardo.restart.reason.txt`
Rason Log:   `bucardo.restart.reason.log`.

Closes GitHub issue #9.

13 years agoMove the reason file to the debug directory.
David E. Wheeler [Tue, 16 Oct 2012 23:30:12 +0000 (16:30 -0700)]
Move the reason file to the debug directory.

Which is `.` by default, so in the default case, it will be the same as the
current behavior. Ref: GitHub Issue #9.

13 years agoSkip the .init and .spec files.
David E. Wheeler [Tue, 16 Oct 2012 23:18:01 +0000 (16:18 -0700)]
Skip the .init and .spec files.

They are not Perl. Maybe distribution-related stuff should go into another directory? `dist` perhaps?

13 years agoAdd --exit-on-nosync option.
David E. Wheeler [Tue, 16 Oct 2012 23:11:55 +0000 (16:11 -0700)]
Add --exit-on-nosync option.

And change the default so that, if there are no active syncs, by default
bucardo will *not* exit. Pass this option to make it exit anyway. Per
discussion; Closes #8

13 years agoMove all but two blocker to-dos to GitHub issues.
David E. Wheeler [Tue, 16 Oct 2012 22:51:09 +0000 (15:51 -0700)]
Move all but two blocker to-dos to GitHub issues.

They are still here, but now with links to GitHub. Could not find the post reporting the bug that checks the wrong tables, so I did not add that one. The other one I did not add was answering all mail list messages.

13 years agoAdd a Linux init script and RPM spec file.
David E. Wheeler [Tue, 2 Oct 2012 22:08:21 +0000 (15:08 -0700)]
Add a Linux init script and RPM spec file.

The latter is forked from Devrim's pgrpms spec file.

13 years agoAdd chkconfig support to the start script.
David E. Wheeler [Mon, 1 Oct 2012 22:59:43 +0000 (15:59 -0700)]
Add chkconfig support to the start script.

13 years agoClean up TODO, add some links.
Greg Sabino Mullane [Sun, 30 Sep 2012 03:50:10 +0000 (23:50 -0400)]
Clean up TODO, add some links.

13 years agoWorkarounds for empty primary key join/split problem found by Bill on mailing list.
Greg Sabino Mullane [Sat, 29 Sep 2012 03:02:25 +0000 (23:02 -0400)]
Workarounds for empty primary key join/split problem found by Bill on mailing list.

13 years agoRemove debug detritus.
Greg Sabino Mullane [Sat, 29 Sep 2012 03:01:39 +0000 (23:01 -0400)]
Remove debug detritus.

13 years agoChange PGIN to IN; consolidate flat and flatpg modes for now.
Greg Sabino Mullane [Thu, 27 Sep 2012 13:03:59 +0000 (09:03 -0400)]
Change PGIN to IN; consolidate flat and flatpg modes for now.

13 years agoand another.
Rosser Schwarz [Thu, 27 Sep 2012 07:04:00 +0000 (00:04 -0700)]
and another.

13 years agooops. missed a spot.
Rosser Schwarz [Thu, 27 Sep 2012 07:02:50 +0000 (00:02 -0700)]
oops.  missed a spot.

13 years agoconsolidating IN and PGIN blocks in delete_rows
Rosser Schwarz [Wed, 26 Sep 2012 04:25:24 +0000 (21:25 -0700)]
consolidating IN and PGIN blocks in delete_rows

13 years agoPrevent empty trailing items from being ignored when doing a split, especially for...
Greg Sabino Mullane [Wed, 26 Sep 2012 03:45:37 +0000 (23:45 -0400)]
Prevent empty trailing items from being ignored when doing a split, especially for the list of primary keys. This should fix a problem reported on the mailing list giving the error "arguments of row IN must all be row expressions"

13 years agoQuick TODO additions
Greg Sabino Mullane [Fri, 21 Sep 2012 20:45:28 +0000 (16:45 -0400)]
Quick TODO additions

13 years agoSince we use MAX(), and the table may have no rows, we need to handle getting back...
Greg Sabino Mullane [Fri, 21 Sep 2012 20:15:34 +0000 (16:15 -0400)]
Since we use MAX(), and the table may have no rows, we need to handle getting back a null, which means that $epoch may be undefined.

13 years agoFix some syntax and other problems; simple tests now show 8.1 works as a valid target...
Greg Sabino Mullane [Thu, 20 Sep 2012 20:38:44 +0000 (16:38 -0400)]
Fix some syntax and other problems; simple tests now show 8.1 works as a valid target database.

13 years agoForce time zone to uppercase GMT for old servers.
Greg Sabino Mullane [Thu, 20 Sep 2012 20:27:37 +0000 (16:27 -0400)]
Force time zone to uppercase GMT for old servers.

13 years agoCheck for cases in which the sync column of bucardo_delta_targets does not exist...
Greg Sabino Mullane [Fri, 14 Sep 2012 17:29:31 +0000 (13:29 -0400)]
Check for cases in which the sync column of bucardo_delta_targets does not exist when doing validate_sync.

13 years agoAdd a single apostrophe to text values for additional quoting checks.
Greg Sabino Mullane [Wed, 12 Sep 2012 22:13:39 +0000 (18:13 -0400)]
Add a single apostrophe to text values for additional quoting checks.

13 years agoReport proper test failure context.
David E. Wheeler [Wed, 12 Sep 2012 22:12:01 +0000 (15:12 -0700)]
Report proper test failure context.

Added a few of these lines to BucardoTesting.pm:

    local $Test::Builder::Level = $Test::Builder::Level + 1;

Because otherwise, Test::Builder reports the failure from the function or
method call in BucardoTesting.pm, rather than the calling `*.t` file. This
will make it easier to find the file and line of the actual test failure.

13 years agoAdd databas now works with the same parameters.
David E. Wheeler [Wed, 12 Sep 2012 21:55:47 +0000 (14:55 -0700)]
Add databas now works with the same parameters.

Greg says, via IRC, "We now allow that, for cool in-place table trimming." So
it seems as though the tests for it should be updated. And so they now are.

13 years agoThe pg_stat_activity PID column name has changed on 9.2.
David E. Wheeler [Wed, 12 Sep 2012 21:41:30 +0000 (14:41 -0700)]
The pg_stat_activity PID column name has changed on 9.2.

So detect if we're on 9.2 or higher, and use the new name, `pid`. Still use
the old name, `procpid`, for older versions of PostgreSQL.

13 years agoTurn list of prereqs into a Pod list and add boolean.
David E. Wheeler [Wed, 12 Sep 2012 21:22:40 +0000 (14:22 -0700)]
Turn list of prereqs into a Pod list and add boolean.

13 years agoReport reason for compile failure.
David E. Wheeler [Wed, 12 Sep 2012 21:14:56 +0000 (14:14 -0700)]
Report reason for compile failure.

13 years agoTests for same-database
Greg Sabino Mullane [Thu, 30 Aug 2012 18:22:31 +0000 (14:22 -0400)]
Tests for same-database

13 years agoAllow databases to have the same dsn, as we are moving towards in-database replication.
Greg Sabino Mullane [Thu, 23 Aug 2012 15:00:00 +0000 (11:00 -0400)]
Allow databases to have the same dsn, as we are moving towards in-database replication.

13 years agoTesting tweaks
Greg Sabino Mullane [Thu, 23 Aug 2012 14:34:57 +0000 (10:34 -0400)]
Testing tweaks

13 years agoNote recent bug
Greg Sabino Mullane [Thu, 19 Jul 2012 11:29:27 +0000 (07:29 -0400)]
Note recent bug

13 years agoNew siganture for 4.99.5 4.99.5
Greg Sabino Mullane [Thu, 31 May 2012 17:40:16 +0000 (13:40 -0400)]
New siganture for 4.99.5

13 years agoUpdate MANIFEST
Greg Sabino Mullane [Thu, 31 May 2012 17:39:54 +0000 (13:39 -0400)]
Update MANIFEST

13 years agoBump to version 4.99.5: get ready for next beta
Greg Sabino Mullane [Thu, 31 May 2012 17:36:59 +0000 (13:36 -0400)]
Bump to version 4.99.5: get ready for next beta

13 years agoMinor sprintf fix to bucardo
Greg Sabino Mullane [Mon, 21 May 2012 16:50:08 +0000 (12:50 -0400)]
Minor sprintf fix to bucardo

13 years agoWe have column names with underscores, thank you very much.
Greg Sabino Mullane [Thu, 10 May 2012 19:39:33 +0000 (15:39 -0400)]
We have column names with underscores, thank you very much.

13 years agoMake the summary usage message more consistent with the man page.
Ali Asad Lotia [Wed, 9 May 2012 20:56:39 +0000 (16:56 -0400)]
Make the summary usage message more consistent with the man page.
Items are listed in similar order on both pages. Additionally,
customname, customcols and customcode are mentioned in the usage
message. Finally the usage information for customname, customcols
and customcode are added to the man page.

13 years agoTesting tweaks.
Greg Sabino Mullane [Wed, 9 May 2012 00:02:09 +0000 (20:02 -0400)]
Testing tweaks.

13 years agoSwitch back to Redis, as Redis::Client does not die smoothly on connection errors.
Greg Sabino Mullane [Tue, 8 May 2012 20:30:52 +0000 (16:30 -0400)]
Switch back to Redis, as Redis::Client does not die smoothly on connection errors.

13 years agoMake sure we remove the tschema test schema in our tests.
Greg Sabino Mullane [Tue, 8 May 2012 20:01:37 +0000 (16:01 -0400)]
Make sure we remove the tschema test schema in our tests.

13 years agoAllow spaces in customnames
Greg Sabino Mullane [Tue, 8 May 2012 19:47:25 +0000 (15:47 -0400)]
Allow spaces in customnames

13 years agoTentative support for multi-column primary keys in MongoDB
Greg Sabino Mullane [Tue, 8 May 2012 19:46:57 +0000 (15:46 -0400)]
Tentative support for multi-column primary keys in MongoDB

13 years agoChanges file cleanups
Greg Sabino Mullane [Mon, 30 Apr 2012 14:15:54 +0000 (10:15 -0400)]
Changes file cleanups

13 years agoDo not map NULL values to Mongo but simply drop them, as MongoDB is schemaless.
Ali Asad Lotia [Mon, 30 Apr 2012 14:12:02 +0000 (10:12 -0400)]
Do not map NULL values to Mongo but simply drop them, as MongoDB is schemaless.

13 years agoQuick inline notes on how to handle common data mismatch problem.
Greg Sabino Mullane [Sun, 29 Apr 2012 19:00:02 +0000 (15:00 -0400)]
Quick inline notes on how to handle common data mismatch problem.

13 years agoChunk up the MongoDB deletes so as not to overwhelm the server on large tables.
Greg Sabino Mullane [Sun, 29 Apr 2012 03:37:46 +0000 (23:37 -0400)]
Chunk up the MongoDB deletes so as not to overwhelm the server on large tables.
May still require changing statement_chunk_size

13 years agoShould be setting, not value
Ed Snajder [Sun, 29 Apr 2012 02:38:50 +0000 (22:38 -0400)]
Should be setting, not value

13 years agoBetter lookup for old bucardo_sequence tables.
Greg Sabino Mullane [Sun, 29 Apr 2012 02:12:40 +0000 (22:12 -0400)]
Better lookup for old bucardo_sequence tables.
Per mailing list question from Ed Snajder

13 years agoCredit last change.
Greg Sabino Mullane [Sat, 28 Apr 2012 23:59:31 +0000 (19:59 -0400)]
Credit last change.

13 years agoAdd 'bucardo list all' to list everything at once.
Christian Recktenwald [Sat, 28 Apr 2012 23:58:14 +0000 (19:58 -0400)]
Add 'bucardo list all' to list everything at once.

13 years agoAdd "one logfile per sync" idea from the ML.
Greg Sabino Mullane [Mon, 23 Apr 2012 19:27:25 +0000 (15:27 -0400)]
Add "one logfile per sync" idea from the ML.

13 years agoFix up table names now that we are capping test3
Greg Sabino Mullane [Wed, 18 Apr 2012 15:18:05 +0000 (11:18 -0400)]
Fix up table names now that we are capping test3

13 years agoTry again for a unique var name
Greg Sabino Mullane [Wed, 18 Apr 2012 14:07:38 +0000 (10:07 -0400)]
Try again for a unique var name

13 years agoDon't use variable names when a column name already exists - some versions of plpgsql...
Greg Sabino Mullane [Tue, 17 Apr 2012 22:04:45 +0000 (18:04 -0400)]
Don't use variable names when a column name already exists - some versions of plpgsql will get confused.

13 years agoShow full name of relation when giving deadlock details. Fix missing comma.
Greg Sabino Mullane [Mon, 2 Apr 2012 16:45:34 +0000 (12:45 -0400)]
Show full name of relation when giving deadlock details. Fix missing comma.

13 years agoSpellcheck tweaks
Greg Sabino Mullane [Tue, 27 Mar 2012 21:19:13 +0000 (17:19 -0400)]
Spellcheck tweaks

13 years agoFinish up the Redis work, including a new test.
Greg Sabino Mullane [Tue, 27 Mar 2012 20:28:15 +0000 (16:28 -0400)]
Finish up the Redis work, including a new test.
Also switch from the Redis Perl driver the Redis::Client, as the latter has hash support.

13 years agoMinor typos.
Greg Sabino Mullane [Tue, 27 Mar 2012 20:26:36 +0000 (16:26 -0400)]
Minor typos.

13 years agoMinor TODO updates.
Greg Sabino Mullane [Fri, 23 Mar 2012 16:30:25 +0000 (12:30 -0400)]
Minor TODO updates.

13 years agoAdd support for MariaDB
Greg Sabino Mullane [Thu, 22 Mar 2012 19:58:15 +0000 (15:58 -0400)]
Add support for MariaDB

13 years agoTesting tweaks for SQLite
Greg Sabino Mullane [Thu, 22 Mar 2012 18:38:21 +0000 (14:38 -0400)]
Testing tweaks for SQLite

13 years agoNo backticks!
Greg Sabino Mullane [Thu, 22 Mar 2012 18:32:54 +0000 (14:32 -0400)]
No backticks!

13 years agoTypo help.
Greg Sabino Mullane [Thu, 22 Mar 2012 18:28:36 +0000 (14:28 -0400)]
Typo help.

13 years agoUpdate testing suite for MySQL.
Greg Sabino Mullane [Thu, 22 Mar 2012 18:28:21 +0000 (14:28 -0400)]
Update testing suite for MySQL.

13 years agoAdjust for case-sensitive table names in testing.
Greg Sabino Mullane [Wed, 21 Mar 2012 18:08:12 +0000 (14:08 -0400)]
Adjust for case-sensitive table names in testing.

13 years agoVarious small tweaks.
Greg Sabino Mullane [Sun, 18 Mar 2012 20:38:57 +0000 (16:38 -0400)]
Various small tweaks.

13 years agoCleanup of conflict code
Greg Sabino Mullane [Sun, 18 Mar 2012 12:45:21 +0000 (08:45 -0400)]
Cleanup of conflict code

13 years agoLower default sleeps; making testing too painful. :)
Greg Sabino Mullane [Sun, 18 Mar 2012 12:42:34 +0000 (08:42 -0400)]
Lower default sleeps; making testing too painful. :)

13 years agoExpand test coverage.
Greg Sabino Mullane [Sun, 18 Mar 2012 12:42:23 +0000 (08:42 -0400)]
Expand test coverage.

13 years agoRemove unused sub. Better debug output during testing.
Greg Sabino Mullane [Sun, 18 Mar 2012 12:41:50 +0000 (08:41 -0400)]
Remove unused sub. Better debug output during testing.

13 years agoSleep a bit after we fork the VAC daemon, to decrease the chances of things blowing...
Greg Sabino Mullane [Fri, 16 Mar 2012 17:41:09 +0000 (13:41 -0400)]
Sleep a bit after we fork the VAC daemon, to decrease the chances of things blowing up if the MCP dies before we call inactivedestroy on the forked handles.

13 years agoBetter checking of "identical" default column expressions.
Greg Sabino Mullane [Fri, 16 Mar 2012 03:17:41 +0000 (23:17 -0400)]
Better checking of "identical" default column expressions.

13 years agoThere are some other related issues, but might as well fix this up in a commit.
Greg Sabino Mullane [Wed, 14 Mar 2012 12:58:00 +0000 (08:58 -0400)]
There are some other related issues, but might as well fix this up in a commit.

13 years agoAllow timestamp columns to not match on startup.
Greg Sabino Mullane [Thu, 8 Mar 2012 20:44:46 +0000 (15:44 -0500)]
Allow timestamp columns to not match on startup.

13 years agoFix up quoting of tablenames.
Greg Sabino Mullane [Thu, 8 Mar 2012 20:41:09 +0000 (15:41 -0500)]
Fix up quoting of tablenames.
Redo the truncate support.
Test with mixed-case tablenames.

13 years agoTest counting tweaks.
Greg Sabino Mullane [Fri, 2 Mar 2012 19:35:54 +0000 (14:35 -0500)]
Test counting tweaks.

13 years agoSequence testing.
Greg Sabino Mullane [Fri, 2 Mar 2012 04:47:41 +0000 (23:47 -0500)]
Sequence testing.

13 years agoFixes for sequences
Greg Sabino Mullane [Fri, 2 Mar 2012 04:47:13 +0000 (23:47 -0500)]
Fixes for sequences

13 years agoAdd tests for sequences.
Greg Sabino Mullane [Tue, 28 Feb 2012 15:27:27 +0000 (10:27 -0500)]
Add tests for sequences.

13 years agoDo not show "old" sequence information if this is a fullcopy, as we are simply blowin...
Greg Sabino Mullane [Tue, 28 Feb 2012 15:09:00 +0000 (10:09 -0500)]
Do not show "old" sequence information if this is a fullcopy, as we are simply blowing it away.

13 years agoMake it easier to add sequences to a herd
Greg Sabino Mullane [Tue, 28 Feb 2012 14:56:07 +0000 (09:56 -0500)]
Make it easier to add sequences to a herd

13 years agoTesting infra: detect sequence diffs.
Greg Sabino Mullane [Tue, 28 Feb 2012 13:39:38 +0000 (08:39 -0500)]
Testing infra: detect sequence diffs.

13 years agoMore support for my horrible typing skills.
Greg Sabino Mullane [Mon, 27 Feb 2012 21:31:36 +0000 (16:31 -0500)]
More support for my horrible typing skills.

13 years agoRemove debug message.
Greg Sabino Mullane [Mon, 27 Feb 2012 21:15:46 +0000 (16:15 -0500)]
Remove debug message.

13 years agoTesting cleanups.
Greg Sabino Mullane [Mon, 27 Feb 2012 21:15:15 +0000 (16:15 -0500)]
Testing cleanups.

13 years agoBetter summary output.
Greg Sabino Mullane [Mon, 27 Feb 2012 12:47:25 +0000 (07:47 -0500)]
Better summary output.

13 years agoMore support for non-standard table names.h
Greg Sabino Mullane [Mon, 27 Feb 2012 12:37:01 +0000 (07:37 -0500)]
More support for non-standard table names.h

13 years agoAdd table with a space to the tests, small adjustments so such tables work.
Greg Sabino Mullane [Sun, 26 Feb 2012 13:11:22 +0000 (08:11 -0500)]
Add table with a space to the tests, small adjustments so such tables work.

13 years agoCleanup the fullcopy test, and refactor things into BucardoTesting.pm
Greg Sabino Mullane [Sun, 26 Feb 2012 00:36:11 +0000 (19:36 -0500)]
Cleanup the fullcopy test, and refactor things into BucardoTesting.pm

13 years agoMore fullcopy/onetimecopy changes.
Greg Sabino Mullane [Sat, 25 Feb 2012 05:31:01 +0000 (00:31 -0500)]
More fullcopy/onetimecopy changes.

13 years agoMessages cleaning
Greg Sabino Mullane [Sat, 25 Feb 2012 05:30:33 +0000 (00:30 -0500)]
Messages cleaning

13 years agoMore cleanup of the fullcopy/onetimecopy system.
Greg Sabino Mullane [Sat, 25 Feb 2012 04:48:02 +0000 (23:48 -0500)]
More cleanup of the fullcopy/onetimecopy system.

13 years agoStill on the fence about repeatable read vs serializable, but let's aim for less...
Greg Sabino Mullane [Fri, 24 Feb 2012 19:15:52 +0000 (14:15 -0500)]
Still on the fence about repeatable read vs serializable, but let's aim for less deadlocks with some slight overhead for the true serializability. See my blog post for more :)

13 years agoShow if a sync is fullcopy or not
Greg Sabino Mullane [Fri, 24 Feb 2012 17:45:29 +0000 (12:45 -0500)]
Show if a sync is fullcopy or not

13 years agoOnly run the VAC daemon if we have eligible databases.
Greg Sabino Mullane [Fri, 24 Feb 2012 17:42:39 +0000 (12:42 -0500)]
Only run the VAC daemon if we have eligible databases.

13 years agoFix typo regarding piddir
Greg Sabino Mullane [Fri, 24 Feb 2012 13:34:50 +0000 (08:34 -0500)]
Fix typo regarding piddir