Re: trouble on windows network share

7 messages, 4 authors, 2016-06-15 · open the first message on its own page

Re: trouble on windows network share

From: Thomas Rast <hidden>
Date: 2016-06-15 22:57:08

David Goldfarb [off-list ref] writes:

Git works correctly under Linux (Ubuntu 12.04; git 1.7.9.5). I've attached the strace outputs. (Note: for reasons that are probably irrelevant, I needed to run the commands sudo'd. Shout back if this is an issue).

Under Windows 7, Cygwin git 1.7.9, commit fails:
U:\foo>git commit -m "added foo2"
error: unable to find 0b89efdeef245ed6a0a7eacc5c578629a141f856
fatal: 0b89efdeef245ed6a0a7eacc5c578629a141f856 is not a valid object

For what it's worth, note that the file does exist.
U:\foo>ls -l .git/objects/0b
total 1024
-rwxrw-r-- 1 ???????? ???????? 74 May 5 01:15 89efdeef245ed6a0a7eacc5c578629a141f856

(I'm not sure why the permissions are trashed. Seems to be a Cygwin thing, or maybe my Cygwin config. The "??????" also appears on local files, and I believe also with files on the old Buffalo drive, so I don't think it is relevant to the problem). Just in case, here's the same dir, as seen from the Ubuntu VM:

deg@ubuntu:/mnt/users/foo$ ls -l .git/objects/0b
total 64
-rwxr-xr-x 0 root root 74 May 5 01:15 89efdeef245ed6a0a7eacc5c578629a141f856

Again, note that there is some user permissions lossage here. I don't know enough about Linux mount or CIFS, and apparently did the mount in a way that everything seems to appear to be stuck owned by root. (same problem I hinted at above). Hope this is not relevant to the problem.

Here's how the same directory looks, when I'm ssh'd into the NAS box itself:

CentralPark:/shares/Users/foo# ls -l .git/objects/0b
total 64
-rwxrw-r-- 1 deg share 74 May 5 01:15 89efdeef245ed6a0a7eacc5c578629a141f856

In any event, the symptoms don't seem to be a permissions problem, so all this extra info is probably just a red herring, I hope.

Hrm.  What about what Jeff already asked of the OP (and AFAICS never got
a reply)?

} If it's a race condition between the write and the subsequent read in
} the same process, then it would be solved by looking at the object
} later. Does "git cat-file -p 6838761d549cf76033d2e9faf5954e62839eb25d"
} work, or is the object forever inaccessible?

In your case: git cat-file -p 0b89efdeef245ed6a0a7eacc5c578629a141f856

-- 
Thomas Rast
trast@{inf,student}.ethz.ch

RE: trouble on windows network share

From: David Goldfarb <hidden>
Date: 2016-06-15 22:57:08

Looks like it works.

From the windows machine:

    U:\foo>git cat-file -p 0b89efdeef245ed6a0a7eacc5c578629a141f856
    100644 blob b02e7c87fe376a353ea4f014bdb3f5200a946b37    foo1
    100644 blob 2cbf64f759a62392ad9dfe1fb9c2cdb175876014    foo2

    U:\foo>


Double-checking that nothing was fixed or changed when I earlier committed the file from Linux, here's a second test:


    U:\foo>git cat-file -p 0b89efdeef245ed6a0a7eacc5c578629a141f856
    100644 blob b02e7c87fe376a353ea4f014bdb3f5200a946b37    foo1
    100644 blob 2cbf64f759a62392ad9dfe1fb9c2cdb175876014    foo2
    
    U:\foo>git status
    # On branch master
    # Untracked files:
    #   (use "git add <file>..." to include in what will be committed)
    #
    #       trace1
    #       trace2
    nothing added to commit but untracked files present (use "git add" to track)
    
    U:\foo>git add trace1
    
    U:\foo>git commit trace1 -m "testing"
    error: unable to find cecae5b4c87ea21aef513fcfcd5c27fe87e0536f
    fatal: cecae5b4c87ea21aef513fcfcd5c27fe87e0536f is not a valid object
    
    U:\foo>git cat-file -p cecae5b4c87ea21aef513fcfcd5c27fe87e0536f
    100644 blob b02e7c87fe376a353ea4f014bdb3f5200a946b37    foo1
    100644 blob 2cbf64f759a62392ad9dfe1fb9c2cdb175876014    foo2
    100644 blob 19102815663d23f8b75a47e7a01965dcdc96468c    test.txt
    100644 blob c9009b02950964cf1d5281125e6e2f647dd9dc16    trace1

   U:\foo>


David

-----Original Message-----
From: Thomas Rast [mailto:trast@inf.ethz.ch] 
Sent: Monday, May 06, 2013 12:42 PM
To: David Goldfarb
Cc: git@vger.kernel.org
Subject: Re: trouble on windows network share

David Goldfarb [off-list ref] writes:

For what it's worth, note that the file does exist.
U:\foo>ls -l .git/objects/0b
total 1024
-rwxrw-r-- 1 ???????? ???????? 74 May 5 01:15
89efdeef245ed6a0a7eacc5c578629a141f856

deg@ubuntu:/mnt/users/foo$ ls -l .git/objects/0b
total 64
-rwxr-xr-x 0 root root 74 May 5 01:15
89efdeef245ed6a0a7eacc5c578629a141f856

Here's how the same directory looks, when I'm ssh'd into the NAS box itself:

CentralPark:/shares/Users/foo# ls -l .git/objects/0b
total 64
-rwxrw-r-- 1 deg share 74 May 5 01:15
89efdeef245ed6a0a7eacc5c578629a141f856

In any event, the symptoms don't seem to be a permissions problem, so all this extra info is probably just a red herring, I hope.

Hrm.  What about what Jeff already asked of the OP (and AFAICS never got a reply)?

} If it's a race condition between the write and the subsequent read in } the same process, then it would be solved by looking at the object } later. Does "git cat-file -p 6838761d549cf76033d2e9faf5954e62839eb25d"
} work, or is the object forever inaccessible?

In your case: git cat-file -p 0b89efdeef245ed6a0a7eacc5c578629a141f856

--
Thomas Rast
trast@{inf,student}.ethz.ch

RE: trouble on windows network share

From: Pyeron, Jason J CTR (US) <hidden>
Date: 2016-06-15 22:57:08

-----Original Message-----
From: Thomas Rast
Sent: Monday, May 06, 2013 5:42 AM

David Goldfarb [off-list ref] writes:

quoted

Git works correctly under Linux (Ubuntu 12.04; git 1.7.9.5).  I've

attached the strace outputs. (Note: for reasons that are probably
irrelevant, I needed to run the commands sudo'd. Shout back if this is
an issue).

quoted

Under Windows 7, Cygwin git 1.7.9, commit fails:
  U:\foo>git commit -m "added foo2"
  error: unable to find 0b89efdeef245ed6a0a7eacc5c578629a141f856
  fatal: 0b89efdeef245ed6a0a7eacc5c578629a141f856 is not a valid

object

quoted

For what it's worth, note that the file does exist.
  U:\foo>ls -l .git/objects/0b
  total 1024
  -rwxrw-r-- 1 ???????? ???????? 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

(I'm not sure why the permissions are trashed. Seems to be a Cygwin

thing, or maybe my Cygwin config. The "??????" also  appears on local
files, and I believe also with files on the old Buffalo drive, so I
don't think it is relevant to the problem).  Just in case, here's the
same dir, as seen from the Ubuntu VM:

quoted

  deg@ubuntu:/mnt/users/foo$ ls -l .git/objects/0b
  total 64
  -rwxr-xr-x 0 root root 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

Again, note that there is some user permissions lossage here. I don't

know enough about Linux mount or CIFS, and apparently did the mount in
a way that everything seems to appear to be stuck owned by root. (same
problem I hinted at above). Hope this is not relevant to the problem.

quoted

Here's how the same directory looks, when I'm ssh'd into the NAS box

itself:

quoted

   CentralPark:/shares/Users/foo# ls -l .git/objects/0b
  total 64
  -rwxrw-r-- 1 deg share 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

In any event, the symptoms don't seem to be a permissions problem, so

all this extra info is probably just a red herring, I hope.

Hrm.  What about what Jeff already asked of the OP (and AFAICS never
got
a reply)?

If referring to me, then yes but it was too big for the list.

} If it's a race condition between the write and the subsequent read in
} the same process, then it would be solved by looking at the object
} later. Does "git cat-file -p
6838761d549cf76033d2e9faf5954e62839eb25d"
} work, or is the object forever inaccessible?

In your case: git cat-file -p 0b89efdeef245ed6a0a7eacc5c578629a141f856

RE: trouble on windows network share

From: David Goldfarb <hidden>
Date: 2016-06-15 22:57:10

Here's one more data point. It suggests that the problem is due to either Cygwin or possibly Git 1.7.9.


My Ubuntu box is actually a VM, hosted by my windows box in VMWare Player.

So, I tried using the VMWare shared folder feature, to mount the Windows U: drive (which is physically on the WD NAS box) as /mnt/hgfs/Host-U on Ubuntu.
Then, I tried linux on the Ubuntu box, fully expecting it to fail as it trampolined through Windows connection to the NAS box).

But, it worked fine.

So, at this point, it became likely that the problem is tied to the different version of Git that I have on the two machines:
- On Ubuntu, git version 1.7.10.4
- On Windows, Cygwin's git version 1.7.9 (which appears to be the latest version for Cygwin).

So, I installed Git on Windows from http://git-scm.com/download/win. Git version 1.8.1.msysgit.1

Triumph: Git on windows works with this git but, on the same file and repo, fails with Cygwin git.

So, either something relevant changed in Git 1.7.10, or (more likely) this is a Cygwin issue.


Jason, are you also using Cygwin git?  Are you also using a WD NAS?

David

-----Original Message-----
From: Pyeron, Jason J CTR (US) [mailto:jason.j.pyeron.ctr@mail.mil] 
Sent: Monday, May 06, 2013 4:11 PM
To: Thomas Rast; David Goldfarb
Cc: git@vger.kernel.org
Subject: RE: trouble on windows network share

-----Original Message-----
From: Thomas Rast
Sent: Monday, May 06, 2013 5:42 AM

David Goldfarb [off-list ref] writes:

quoted

Git works correctly under Linux (Ubuntu 12.04; git 1.7.9.5).  I've

attached the strace outputs. (Note: for reasons that are probably
irrelevant, I needed to run the commands sudo'd. Shout back if this is
an issue).

quoted

Under Windows 7, Cygwin git 1.7.9, commit fails:
  U:\foo>git commit -m "added foo2"
  error: unable to find 0b89efdeef245ed6a0a7eacc5c578629a141f856
  fatal: 0b89efdeef245ed6a0a7eacc5c578629a141f856 is not a valid

object

quoted

For what it's worth, note that the file does exist.
  U:\foo>ls -l .git/objects/0b
  total 1024
  -rwxrw-r-- 1 ???????? ???????? 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

(I'm not sure why the permissions are trashed. Seems to be a Cygwin

thing, or maybe my Cygwin config. The "??????" also  appears on local
files, and I believe also with files on the old Buffalo drive, so I
don't think it is relevant to the problem).  Just in case, here's the
same dir, as seen from the Ubuntu VM:

quoted

  deg@ubuntu:/mnt/users/foo$ ls -l .git/objects/0b
  total 64
  -rwxr-xr-x 0 root root 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

Again, note that there is some user permissions lossage here. I don't

know enough about Linux mount or CIFS, and apparently did the mount in
a way that everything seems to appear to be stuck owned by root. (same
problem I hinted at above). Hope this is not relevant to the problem.

quoted

Here's how the same directory looks, when I'm ssh'd into the NAS box

itself:

quoted

   CentralPark:/shares/Users/foo# ls -l .git/objects/0b
  total 64
  -rwxrw-r-- 1 deg share 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

In any event, the symptoms don't seem to be a permissions problem, so

all this extra info is probably just a red herring, I hope.

Hrm.  What about what Jeff already asked of the OP (and AFAICS never
got
a reply)?

If referring to me, then yes but it was too big for the list.

} If it's a race condition between the write and the subsequent read in
} the same process, then it would be solved by looking at the object
} later. Does "git cat-file -p
6838761d549cf76033d2e9faf5954e62839eb25d"
} work, or is the object forever inaccessible?

In your case: git cat-file -p 0b89efdeef245ed6a0a7eacc5c578629a141f856

RE: trouble on windows network share

From: Pyeron, Jason J CTR (US) <hidden>
Date: 2016-06-15 22:57:11

-----Original Message-----
From: David Goldfarb 
Sent: Wednesday, May 08, 2013 5:38 AM

Here's one more data point. It suggests that the problem is due to
either Cygwin or possibly Git 1.7.9.


My Ubuntu box is actually a VM, hosted by my windows box in VMWare
Player.

So, I tried using the VMWare shared folder feature, to mount the
Windows U: drive (which is physically on the WD NAS box) as
/mnt/hgfs/Host-U on Ubuntu.
Then, I tried linux on the Ubuntu box, fully expecting it to fail as it
trampolined through Windows connection to the NAS box).

But, it worked fine.

So, at this point, it became likely that the problem is tied to the
different version of Git that I have on the two machines:
- On Ubuntu, git version 1.7.10.4
- On Windows, Cygwin's git version 1.7.9 (which appears to be the
latest version for Cygwin).

So, I installed Git on Windows from http://git-scm.com/download/win.
Git version 1.8.1.msysgit.1

Triumph: Git on windows works with this git but, on the same file and
repo, fails with Cygwin git.

So, either something relevant changed in Git 1.7.10, or (more likely)
this is a Cygwin issue.

Likely.


Jason, are you also using Cygwin git?  Are you also using a WD NAS?

Cygwin, yes. I am going to spend some time (likely this weekend) to get the current version to compile on Cygwin.

WD NAS, no. Windows Server 2008 with NTFS file system on internal raid.

David

-----Original Message-----
From: Pyeron, Jason J CTR (US) [mailto:jason.j.pyeron.ctr@mail.mil]
Sent: Monday, May 06, 2013 4:11 PM
To: Thomas Rast; David Goldfarb
Cc: git@vger.kernel.org
Subject: RE: trouble on windows network share

quoted

-----Original Message-----
From: Thomas Rast
Sent: Monday, May 06, 2013 5:42 AM

David Goldfarb [off-list ref] writes:

quoted

Git works correctly under Linux (Ubuntu 12.04; git 1.7.9.5).  I've

attached the strace outputs. (Note: for reasons that are probably
irrelevant, I needed to run the commands sudo'd. Shout back if this

is

quoted

an issue).

quoted

Under Windows 7, Cygwin git 1.7.9, commit fails:
  U:\foo>git commit -m "added foo2"
  error: unable to find 0b89efdeef245ed6a0a7eacc5c578629a141f856
  fatal: 0b89efdeef245ed6a0a7eacc5c578629a141f856 is not a valid

object

quoted

For what it's worth, note that the file does exist.
  U:\foo>ls -l .git/objects/0b
  total 1024
  -rwxrw-r-- 1 ???????? ???????? 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

(I'm not sure why the permissions are trashed. Seems to be a Cygwin

thing, or maybe my Cygwin config. The "??????" also  appears on local
files, and I believe also with files on the old Buffalo drive, so I
don't think it is relevant to the problem).  Just in case, here's the
same dir, as seen from the Ubuntu VM:

quoted

  deg@ubuntu:/mnt/users/foo$ ls -l .git/objects/0b
  total 64
  -rwxr-xr-x 0 root root 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

Again, note that there is some user permissions lossage here. I

don't

quoted

know enough about Linux mount or CIFS, and apparently did the mount

in

quoted

a way that everything seems to appear to be stuck owned by root.

(same

quoted

problem I hinted at above). Hope this is not relevant to the problem.

quoted

Here's how the same directory looks, when I'm ssh'd into the NAS

box

quoted

itself:

quoted

   CentralPark:/shares/Users/foo# ls -l .git/objects/0b
  total 64
  -rwxrw-r-- 1 deg share 74 May  5 01:15

89efdeef245ed6a0a7eacc5c578629a141f856

quoted

In any event, the symptoms don't seem to be a permissions problem,

so

quoted

all this extra info is probably just a red herring, I hope.

Hrm.  What about what Jeff already asked of the OP (and AFAICS never
got
a reply)?

If referring to me, then yes but it was too big for the list.

quoted

} If it's a race condition between the write and the subsequent read

in

quoted

} the same process, then it would be solved by looking at the object
} later. Does "git cat-file -p
6838761d549cf76033d2e9faf5954e62839eb25d"
} work, or is the object forever inaccessible?

In your case: git cat-file -p

0b89efdeef245ed6a0a7eacc5c578629a141f856

Re: trouble on windows network share

From: Phil Wiffen <hidden>
Date: 2016-06-15 22:59:22

Did anyone ever get to the bottom of this? I'm seeing this exact issue on
both NetApp storage systems with SMB 2.x enabled and also on Windows 7 and
Server 2008 R2 shares (which also use SMB 2.x). If we use SMB 1.x (such as
XP), things work fine.

RE: trouble on windows network share

From: Pyeron, Jason J CTR (US) <hidden>
Date: 2016-06-15 22:59:22

That is a new detail (SMB 1 vs. 2) that can be used to debug this further.

-----Original Message-----
From: git-owner@vger.kernel.org [mailto:git-owner@vger.kernel.org] On
Behalf Of Phil Wiffen
Sent: Tuesday, December 03, 2013 11:48 AM
To: git@vger.kernel.org
Subject: Re: trouble on windows network share

Did anyone ever get to the bottom of this? I'm seeing this exact issue
on
both NetApp storage systems with SMB 2.x enabled and also on Windows 7
and
Server 2008 R2 shares (which also use SMB 2.x). If we use SMB 1.x (such
as
XP), things work fine.

--
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

`h`	back out one level
`j`	next message in thread
`k`	previous message in thread
`l`	drill in
`Esc`	close help / fold thread tree
`?`	toggle this help