Limitiations of git rebase --preserve-merges --interactive

12 messages, 5 authors, 2016-09-23 · open the first message on its own page

Limitiations of git rebase --preserve-merges --interactive

From: Stefan Haller <hidden>
Date: 2016-09-20 08:54:49

The BUGS section of the git-rebase manpage says that editing or
rewording commits "should work fine", but attempts to reorder commits
usually don't do what you want.

I'd like to know more about what does or doesn't work. For example, will
squashing commits work? (I.e. using the "fixup" or "squash" commands in
the todo sheet.)

Will dropping commits work?

Does it make sense to insert "exec" commands, or will they run at
arbitrary times?


-- 
Stefan Haller
Berlin, Germany
http://www.haller-berlin.de/

Re: Limitiations of git rebase --preserve-merges --interactive

From: Anatoly Borodin <hidden>
Date: 2016-09-22 19:33:43

Hi Stefan,

this section was added to the manual in the commit
cddb42d2c58a9de9b2b5ef68817778e7afaace3e by "Jonathan Nieder"
[off-list ref] 6 years ago. Maybe he remembers better?

-- 
Mit freundlichen Grüßen,
Anatoly Borodin

Re: Limitiations of git rebase --preserve-merges --interactive

From: Kevin Daudt <hidden>
Date: 2016-09-22 19:49:08

On Thu, Sep 22, 2016 at 07:33:11PM +0000, Anatoly Borodin wrote:
Hi Stefan,

this section was added to the manual in the commit
cddb42d2c58a9de9b2b5ef68817778e7afaace3e by "Jonathan Nieder"
[off-list ref] 6 years ago. Maybe he remembers better?
Just to make it clear, this section explicitly talks about 'bugs' with
preserve-merges and interactive rebase.  Without the --preserve-merges
option, those operations works as expected.

The reason, as that section explains, is that it's not possible to store
the merge structure in the flat todo list. I assume this means git
internally remembers where the merge commit was, and then restores it
while rebasing.

Changing the order, or dropping commits might then give unexpected
results.

Re: Limitiations of git rebase --preserve-merges --interactive

From: Stefan Beller <hidden>
Date: 2016-09-22 20:54:32

On Thu, Sep 22, 2016 at 12:48 PM, Kevin Daudt [off-list ref] wrote:
On Thu, Sep 22, 2016 at 07:33:11PM +0000, Anatoly Borodin wrote:
quoted
Hi Stefan,

this section was added to the manual in the commit
cddb42d2c58a9de9b2b5ef68817778e7afaace3e by "Jonathan Nieder"
[off-list ref] 6 years ago. Maybe he remembers better?
Just to make it clear, this section explicitly talks about 'bugs' with
preserve-merges and interactive rebase.  Without the --preserve-merges
option, those operations works as expected.

The reason, as that section explains, is that it's not possible to store
the merge structure in the flat todo list. I assume this means git
internally remembers where the merge commit was, and then restores it
while rebasing.

Changing the order, or dropping commits might then give unexpected
results.
The commit message may help as well:

    rebase -i -p: document shortcomings

    The rebase --preserve-merges facility presents a list of commits
    in its instruction sheet and uses a separate table to keep
    track of their parents.  Unfortunately, in practice this means
    that with -p after most attempts to rearrange patches, some
    commits have the "wrong" parent and the resulting history is
    rarely what the caller expected.

    Yes, it would be nice to fix that.  But first, add a warning to the
    manual to help the uninitiated understand what is going on.

Re: Limitiations of git rebase --preserve-merges --interactive

From: Anatoly Borodin <hidden>
Date: 2016-09-22 21:02:16

Hi Stefan,

I've also done some archaeology and found that the original version of
the merge preserving code was written by Johannes Schindelin
[off-list ref], see e.g.
f09c9b8c5ff9d8a15499b09ccd6c3e7b3c76af77

There were also some big discussion threads in 2007-2008 regarding a
better mechanism to "mark" or "tag" the heads of rebased branches, but I
haven't seen consensus and development in that direction after that.

PS There are also some pieces of "what should work" in these tests:

t/t3409-rebase-preserve-merges.sh*
t/t3410-rebase-preserve-dropped-merges.sh*
t/t3411-rebase-preserve-around-merges.sh*
t/t3414-rebase-preserve-onto.sh*


-- 
Mit freundlichen Grüßen,
Anatoly Borodin

Re: Limitiations of git rebase --preserve-merges --interactive

From: Anatoly Borodin <hidden>
Date: 2016-09-22 21:05:19

Hi Kevin,

Kevin Daudt [off-list ref] wrote:
Changing the order, or dropping commits might then give unexpected
results.
The question that Stefan has is rather "what is *supposed* to work /
give *expected* results?". Some stuff can be found in the tests
(t/t*rebase*preserve*), but maybe there is more?

-- 
Mit freundlichen Grüßen,
Anatoly Borodin

Re: Limitiations of git rebase --preserve-merges --interactive

From: Stefan Beller <hidden>
Date: 2016-09-22 21:08:22

On Thu, Sep 22, 2016 at 2:01 PM, Anatoly Borodin
[off-list ref] wrote:
Hi Stefan,

I've also done some archaeology and found that the original version of
the merge preserving code was written by Johannes Schindelin
[off-list ref], see e.g.
I think it would be helpful if you'd cc those folks involved, not just
the mailing list.

Re: Limitiations of git rebase --preserve-merges --interactive

From: Stefan Haller <hidden>
Date: 2016-09-23 10:40:36

Anatoly Borodin [off-list ref] wrote:
PS There are also some pieces of "what should work" in these tests:

t/t3409-rebase-preserve-merges.sh*
t/t3410-rebase-preserve-dropped-merges.sh*
t/t3411-rebase-preserve-around-merges.sh*
t/t3414-rebase-preserve-onto.sh*
Thanks, this is interesting; I'm having trouble understanding the tests
though. Some of them use rebase -p -i, but I don't understand why they
use -i, or why that even works in a test (i.e. why it doesn't open an
editor).

In one test I saw "GIT_EDITOR=: git rebase -i -p", which I guess means
"use the initially given todo sheet unchanged". I don't see any tests
that do an interactive rebase and actually change the todo list.


-- 
Stefan Haller
Berlin, Germany
http://www.haller-berlin.de/

Re: Limitiations of git rebase --preserve-merges --interactive

From: Stefan Haller <hidden>
Date: 2016-09-23 10:40:41

Stefan Beller [off-list ref] wrote:
On Thu, Sep 22, 2016 at 12:48 PM, Kevin Daudt [off-list ref] wrote:
quoted
On Thu, Sep 22, 2016 at 07:33:11PM +0000, Anatoly Borodin wrote:
quoted
Hi Stefan,

this section was added to the manual in the commit
cddb42d2c58a9de9b2b5ef68817778e7afaace3e by "Jonathan Nieder"
[off-list ref] 6 years ago. Maybe he remembers better?
Just to make it clear, this section explicitly talks about 'bugs' with
preserve-merges and interactive rebase.  Without the --preserve-merges
option, those operations works as expected.

The reason, as that section explains, is that it's not possible to store
the merge structure in the flat todo list. I assume this means git
internally remembers where the merge commit was, and then restores it
while rebasing.

Changing the order, or dropping commits might then give unexpected
results.
The commit message may help as well:

    rebase -i -p: document shortcomings

    The rebase --preserve-merges facility presents a list of commits
    in its instruction sheet and uses a separate table to keep
    track of their parents.  Unfortunately, in practice this means
    that with -p after most attempts to rearrange patches, some
    commits have the "wrong" parent and the resulting history is
    rarely what the caller expected.

    Yes, it would be nice to fix that.  But first, add a warning to the
    manual to help the uninitiated understand what is going on.
Thanks, but all of this still talks about the issues in very generic
terms ("most attempts to rearrange patches"). I'm interested in more
details as to exactly what kind of attempts do or don't work. In
particular, I'm interested in fixup/squash commands (without reordering
anything else), or dropping (non-merge) commits.

I could of course experiment with these and try to find out myself, but
I was hoping someone would just know the answer off the top of their
head, saving me some time.


-- 
Stefan Haller
Berlin, Germany
http://www.haller-berlin.de/

Re: Limitiations of git rebase --preserve-merges --interactive

From: Johannes Schindelin <hidden>
Date: 2016-09-23 21:04:36

Hi,

On Thu, 22 Sep 2016, Stefan Beller wrote:
On Thu, Sep 22, 2016 at 2:01 PM, Anatoly Borodin
[off-list ref] wrote:
quoted
Hi Stefan,

I've also done some archaeology and found that the original version of
the merge preserving code was written by Johannes Schindelin
[off-list ref], see e.g.
I think it would be helpful if you'd cc those folks involved, not just
the mailing list.
Indeed. It is quite tedious to re-Cc: people. Anatoly, please do not force
me to put in that work in the future.

Also: I mentioned recently that I am not happy with the original design,
either, and that I came up with a new design that I intend to port to the
rebase--helper, once it is included in an official Git version:

https://public-inbox.org/git/alpine.DEB.2.20.1609111027330.129229@virtualbox/

Ciao,
Johannes

Re: Limitiations of git rebase --preserve-merges --interactive

From: Johannes Schindelin <hidden>
Date: 2016-09-23 21:13:28

Hi Stefan,

On Fri, 23 Sep 2016, Stefan Haller wrote:
Stefan Beller [off-list ref] wrote:
quoted
On Thu, Sep 22, 2016 at 12:48 PM, Kevin Daudt [off-list ref] wrote:
quoted
On Thu, Sep 22, 2016 at 07:33:11PM +0000, Anatoly Borodin wrote:
quoted
Hi Stefan,

this section was added to the manual in the commit
cddb42d2c58a9de9b2b5ef68817778e7afaace3e by "Jonathan Nieder"
[off-list ref] 6 years ago. Maybe he remembers better?
Just to make it clear, this section explicitly talks about 'bugs' with
preserve-merges and interactive rebase.  Without the --preserve-merges
option, those operations works as expected.

The reason, as that section explains, is that it's not possible to store
the merge structure in the flat todo list. I assume this means git
internally remembers where the merge commit was, and then restores it
while rebasing.

Changing the order, or dropping commits might then give unexpected
results.
The commit message may help as well:

    rebase -i -p: document shortcomings

    The rebase --preserve-merges facility presents a list of commits
    in its instruction sheet and uses a separate table to keep
    track of their parents.  Unfortunately, in practice this means
    that with -p after most attempts to rearrange patches, some
    commits have the "wrong" parent and the resulting history is
    rarely what the caller expected.

    Yes, it would be nice to fix that.  But first, add a warning to the
    manual to help the uninitiated understand what is going on.
Thanks, but all of this still talks about the issues in very generic
terms ("most attempts to rearrange patches"). I'm interested in more
details as to exactly what kind of attempts do or don't work. In
particular, I'm interested in fixup/squash commands (without reordering
anything else), or dropping (non-merge) commits.

I could of course experiment with these and try to find out myself, but
I was hoping someone would just know the answer off the top of their
head, saving me some time.
The fundamental problem here is the underlying design of bolting on the
"recreate a merge" functionality onto the "pick" command.

That is, if you try to rebase non-linear commit history, it will still
generate a linear list of "pick <commit-name>" lines, as if it were
linear, except that it will include the merge commits, too.

It then will try to guess what you want to do by recording which commit
was rewritten as which commit. And when it encounters a "pick" with a
merge commit, it will try to merge the *rewritten* commit.

In other words, the design does not allow for changing the tip of any
merged branch. Not reordering, not dropping.

And I do not think that there is a way to fix that design. That is why I
came up with the Git garden shears (see the link I sent elsewhere in this
thread).

Ciao,
Johannes

Re: Limitiations of git rebase --preserve-merges --interactive

From: Stefan Beller <hidden>
Date: 2016-09-23 22:26:14

On Fri, Sep 23, 2016 at 2:13 PM, Johannes Schindelin
[off-list ref] wrote:
Hi Stefan,

On Fri, 23 Sep 2016, Stefan Haller wrote:
quoted
Stefan Beller [off-list ref] wrote:
quoted
On Thu, Sep 22, 2016 at 12:48 PM, Kevin Daudt [off-list ref] wrote:
quoted
On Thu, Sep 22, 2016 at 07:33:11PM +0000, Anatoly Borodin wrote:
quoted
Hi Stefan,

this section was added to the manual in the commit
cddb42d2c58a9de9b2b5ef68817778e7afaace3e by "Jonathan Nieder"
[off-list ref] 6 years ago. Maybe he remembers better?
Just to make it clear, this section explicitly talks about 'bugs' with
preserve-merges and interactive rebase.  Without the --preserve-merges
option, those operations works as expected.

The reason, as that section explains, is that it's not possible to store
the merge structure in the flat todo list. I assume this means git
internally remembers where the merge commit was, and then restores it
while rebasing.

Changing the order, or dropping commits might then give unexpected
results.
The commit message may help as well:

    rebase -i -p: document shortcomings

    The rebase --preserve-merges facility presents a list of commits
    in its instruction sheet and uses a separate table to keep
    track of their parents.  Unfortunately, in practice this means
    that with -p after most attempts to rearrange patches, some
    commits have the "wrong" parent and the resulting history is
    rarely what the caller expected.

    Yes, it would be nice to fix that.  But first, add a warning to the
    manual to help the uninitiated understand what is going on.
Thanks, but all of this still talks about the issues in very generic
terms ("most attempts to rearrange patches"). I'm interested in more
details as to exactly what kind of attempts do or don't work. In
particular, I'm interested in fixup/squash commands (without reordering
anything else), or dropping (non-merge) commits.

I could of course experiment with these and try to find out myself, but
I was hoping someone would just know the answer off the top of their
head, saving me some time.
The fundamental problem here is the underlying design of bolting on the
"recreate a merge" functionality onto the "pick" command.

That is, if you try to rebase non-linear commit history, it will still
generate a linear list of "pick <commit-name>" lines, as if it were
linear, except that it will include the merge commits, too.
Which on a more fundamental design level would be ok.
(C.f. your shell history is a linear list of git commands, but it
deals just fine
with non linear DAGSs)
It then will try to guess what you want to do by recording which commit
was rewritten as which commit. And when it encounters a "pick" with a
merge commit, it will try to merge the *rewritten* commit.
Instead of guessing we'd need to differentiate between "pick" and "pickmerge",
whereas the later describes creating commits with more than one parent (i.e.
the prior pick line).

I could imagine the "pickmerge" to list all additional parents (The
first parent being
the previously picked commit) via symbolic naming:

    pick 1234affe implement foo
    pickmerge 3456feed origin/js/new-feature-1 # Merge origin/js/new-feature-1
    pick 45678ead implement feature-2

The "pickmerge" would have first the merge tips, and then the old
subject line after
a # character.
In other words, the design does not allow for changing the tip of any
merged branch. Not reordering, not dropping.
I see how the current design is problematic as there is no argument
possible that
allows the user to correct the wrong guess.
And I do not think that there is a way to fix that design. That is why I
came up with the Git garden shears (see the link I sent elsewhere in this
thread).
I'll look into that.

Thanks,
Stefan
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help