From: Nicolas Pitre <nico@cam.org>
To: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Alexander Litvinov <litvinov2004@gmail.com>,
Git Mailing List <git@vger.kernel.org>
Subject: Re: My git repo is broken, how to fix it ?
Date: Thu, 22 Mar 2007 12:34:02 -0400 (EDT) [thread overview]
Message-ID: <alpine.LFD.0.83.0703221215150.18328@xanadu.home> (raw)
In-Reply-To: <Pine.LNX.4.64.0703220847540.6730@woody.linux-foundation.org>
On Thu, 22 Mar 2007, Linus Torvalds wrote:
> Ok, apart from #1, those should be in current -git now, along with better
> validation checks (by Nico) when packing. So hopefully at least when there
> is corruption in a loose object, we will now always notice when we do a
> "git repack", and will never generate a broken pack-file. Knock wood.
Not yet actually. What I did do is to make index-pack perform more
validation and ensure it never accept SHA1 collisions.
For the repack case... I think there should be a better way. Either we
revalidate the full SHA1 which would be expensive as we'd basically lose
most advantages of direct pack data copy.
What I'm pondering is some sort of lightweight checksum like adler32 for
object data in the pack but stored in the index. Since index-pack
already perform the full SHA1 already, it could as well provide a
checksum for the raw pack object data for the repack case. Currently we
try to validate reused pack data by attempting an inflate pass on the
object payload, but that doesn't validate the object type nor the
reference SHA1 to delta base objects which could get corrupted and
copied without noticing into another pack.
> Of course, I actually wonder if the bug might be in your version of zlib
> (miscompiled or some other thing), in which case *any* amount of
> pre-validation won't really help, because it will become corrupted when we
> deflate it prior to writing. For example, if "deflateBound()" sometimes
> doesn't give a valid upper bound and we allocate too little space..
Well, since we provide the size of the allocated output buffer to zlib
it would be seriously broken if it overflowed it. Also zlib perform a
checksum verification of the deflated data if I remember correctly. So
it seems to me that zlib should be quite self validating already.
Nicolas
next prev parent reply other threads:[~2007-03-22 16:34 UTC|newest]
Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top
2007-02-28 4:36 My git repo is broken, how to fix it ? Alexander Litvinov
2007-02-28 4:57 ` Linus Torvalds
2007-02-28 11:54 ` Alexander Litvinov
2007-02-28 16:19 ` Linus Torvalds
2007-02-28 19:12 ` Alex Riesen
2007-03-19 13:32 ` Alexander Litvinov
2007-03-19 15:20 ` Linus Torvalds
[not found] ` <200703201013.39169.litvinov2004@gmail.com>
2007-03-20 5:34 ` Linus Torvalds
2007-03-20 6:55 ` Alexander Litvinov
2007-03-20 7:42 ` Junio C Hamano
2007-03-20 15:23 ` Nicolas Pitre
[not found] ` <Pine.LNX.4.64.0703200832150.6730@woody.linux-foundation.org>
[not found] ` <Pine.LNX.4.64.0703200836490.6730@woody.linux-foundation.org>
[not found] ` <200703210956.50018.litvinov2004@gmail.com>
2007-03-22 15:58 ` Linus Torvalds
2007-03-22 16:34 ` Nicolas Pitre [this message]
[not found] ` <200703211024.04740.litvinov2004@gmail.com>
2007-03-22 16:17 ` Linus Torvalds
2007-03-22 16:29 ` Linus Torvalds
2007-03-22 16:48 ` Linus Torvalds
2007-03-22 17:01 ` Nicolas Pitre
2007-03-22 17:10 ` Linus Torvalds
2007-03-22 17:28 ` Nicolas Pitre
2007-03-22 22:13 ` Jeff King
2007-03-23 0:25 ` Linus Torvalds
2007-03-23 0:42 ` Bill Lear
2007-03-23 0:51 ` Jeff King
2007-03-22 20:31 ` [PATCH] git-apply: Do not free the wrong buffer when we convert the data for writeout Junio C Hamano
2007-03-22 20:55 ` Linus Torvalds
2007-03-23 3:55 ` Alexander Litvinov
2007-03-23 3:40 ` My git repo is broken, how to fix it ? Alexander Litvinov
2007-03-22 17:12 ` Johannes Sixt
-- strict thread matches above, loose matches on Subject: below --
2021-06-06 17:27 B
2021-06-06 17:28 B
2021-12-25 8:30 Joseph Mitchell
2021-12-26 0:48 ` Lemuria
2023-05-29 18:57 ross thomas
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=alpine.LFD.0.83.0703221215150.18328@xanadu.home \
--to=nico@cam.org \
--cc=git@vger.kernel.org \
--cc=litvinov2004@gmail.com \
--cc=torvalds@linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).