From 8eca0987cfbcea8b1276d9852fb26d0ddb11ed3b Mon Sep 17 00:00:00 2001 From: Eric Wong Date: Sun, 5 Mar 2023 22:18:11 +0000 Subject: doc: update public-inbox-clone examples and help Basically, public-inbox-clone has become grok-pull without config files nor absolute paths. --- Documentation/public-inbox-clone.pod | 62 ++++++++++++++++++++++++++++-------- 1 file changed, 49 insertions(+), 13 deletions(-) (limited to 'Documentation') diff --git a/Documentation/public-inbox-clone.pod b/Documentation/public-inbox-clone.pod index 7774d4ed..af4e8e95 100644 --- a/Documentation/public-inbox-clone.pod +++ b/Documentation/public-inbox-clone.pod @@ -15,14 +15,16 @@ making the initial clone of a remote HTTP(S) public-inbox. It allows cloning multi-epoch v2 inboxes with a single command and zero configuration. -In public-inbox 2.0+, public-inbox-clone can also mirror multiple -inboxes or code repositories using manifest.js.gz files like -L from grokmirror. +In public-inbox 2.0+, public-inbox-clone can create and maintain +a mirror of multiple inboxes or code repositories using manifest.js.gz +files like L from grokmirror. L is +NOT required when using this mode. It does not run L nor L. Those commands must be run separately if serving/searching the mirror is required. As-is, -public-inbox-clone is suitable for creating a git-only backup. +public-inbox-clone is suitable for creating a git-only backup +without Xapian and SQLite indices. When cloning a single inbox, public-inbox-clone creates a Makefile with handy targets to update the inbox once indexed. @@ -31,11 +33,12 @@ not be rewritten by L unless it is removed completely. public-inbox-clone does not use nor require any extra -configuration files (not even C<~/.public-inbox/config>). +configuration files (not even C<~/.public-inbox/config>), +but it can download snippets suitable for adding to any +L file. L may be used to keep a single C -up-to-date. When using manifest.js.gz, public-inbox-clone is used -to maintain the multi-repository mirror. +up-to-date. For v2 inboxes, it will create a C<$INBOX_DIR/manifest.js.gz> file to speed up subsequent L. @@ -63,17 +66,17 @@ Default: C<0..~0> or C<0..> or C<..~0> =item --include=PATTERN -When cloning a top-level with multiple inboxes, only clone inboxes and -repositories matching a given wildcard pattern (using C<*?> and C<[]> is -supported). +When cloning a top-level with multiple inboxes via manifest, +only clone inboxes and repositories matching a given wildcard pattern +(using C<*?> and C<[]> is supported). This is a new option in public-inbox 2.0+ =item --exclude=PATTERN -When cloning a top-level with multiple inboxes, ignore inboxes and -repositories matching the given wildcard pattern. Supports the same -wildcards as L +When cloning a top-level with multiple inboxes via manifest, +ignore inboxes and repositories matching the given wildcard pattern. +Supports the same wildcards as L This is a new option in public-inbox 2.0+ @@ -204,6 +207,39 @@ Whether to wrap L and L commands with L. Default: C +=item -j JOBS +=item --jobs=JOBS + +The number of parallel processes to spawn at once for various network +operations using L and/or L. + +=back + +=head1 EXAMPLES + +=for comment +Sticking to smaller projects in examples to minimize load on servers + +=over + +=item To mirror the most recent epochs of dwarves and LTTng inboxes: + + public-inbox-clone --epoch=~0 \ + --include='*lttng*' --include='*dwarves' \ + https://80x24.org/lore/ /path/to/inbox-mirror + +C may be used instead of C + +=item To mirror all code repos of the sparse project: + + public-inbox-clone --objstore= --project-list= --prune \ + --include='*sparse*' --inbox-config=never \ + --remote-manifest=https://80x24.org/lore/pub/manifest.js.gz \ + https://80x24.org/lore/ /path/to/code-mirror + +C may be used instead of C +and the C<--remote-manifest> option can be omitted. + =back =head1 CONTACT -- cgit v1.2.3-24-ge0c7