[GIT] Networking

30 messages, 6 authors, 2011-03-22 · open the first message on its own page

[GIT] Networking

From: David Miller <davem@davemloft.net>
Date: 2011-03-21 02:51:21

1) The R8169 PHY fix from Eric Dumazet, which I see you've added to
   your tree too. :-)

2) NIU driver broken by OF layer changes, fix by eliminating platform
   device name conflict.

3) Fix VHOST receive queue locking, from Michael S. Tsirkin.

4) Some gianfar chips are buggy wrt. checksums for certain packet
   buffer alignments, fall back to sw checksumming in those cases.
   From Alex Dubov.

5) ECONET leaks 4 uninitialized bytes to the network, fix from Vasiliy
   Kulikov.

6) Fix blind deref of ethtool_ops->set_sg(), fix from Roger Luethi.

7) ethtool_rxnfc needs syscall compat handling, from Ben Hutchings.

8) VLAN broken over gre tunnels because it does not take
   ->needed_headroom into account.  Fix from Eric Dumazet.

9) Bridging netfilter needs to init IPCB() of skb before injecting
   packet into the IP stack, fix from Herbert Xu.

10) ftmac100 has off-by-one error, fix by using resource_size().  Fix
    from Dan Carpenter.

11) IPSET fixes from Jozsef Kadlecsik.

12) Netfilter xtables has some reentrancy issues, fix from Eric Dumazet.

13) CLUSTERIP netfilter iptablesm module needs to check user buffer size
    more carefully, fix from Vasiliy Kulikov.

Please pull, thanks a lot!

The following changes since commit a44f99c7efdb88fa41128065c9a9445c19894e34:

  Merge branch 'trivial' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6 (2011-03-20 18:14:55 -0700)

are available in the git repository at:

  master.kernel.org:/pub/scm/linux/kernel/git/davem/net-2.6.git master

Alex Dubov (1):
      gianfar: Fall back to software tcp/udp checksum on older controllers

Ben Hutchings (1):
      ethtool: Compat handling for struct ethtool_rxnfc

Dan Carpenter (1):
      ftmac100: use resource_size()

David S. Miller (3):
      niu: Rename NIU parent platform device name to fix conflict.
      Merge branch 'master' of git://git.kernel.org/.../kaber/nf-2.6
      Merge branch 'vhost-net-next' of git://git.kernel.org/.../mst/vhost

Eric Dumazet (3):
      vlan: should take into account needed_headroom
      r8169: fix a bug in rtl8169_init_phy()
      netfilter: xtables: fix reentrancy

Herbert Xu (1):
      bridge: Reset IPCB when entering IP stack on NF_FORWARD

Jason Wang (3):
      vhost-net: check the support of mergeable buffer outside the receive loop
      vhost-net: Unify the code of mergeable and big buffer handling
      vhost: lock receive queue, not the socket

Jozsef Kadlecsik (2):
      netfilter: ipset: fix address ranges at hash:*port* types
      netfilter: ipset: fix checking the type revision at create command

Krishna Kumar (1):
      vhost: Cleanup vhost.c and net.c

Michael S. Tsirkin (2):
      vhost: copy_from_user -> __copy_from_user
      vhost-net: remove unlocked use of receive_queue

Mike Frysinger (1):
      headers: use __aligned_xx types for userspace

Nicolas de Pesloüan (1):
      bonding: fix a typo in a comment

Roger Luethi (1):
      ethtool: __ethtool_set_sg: check for function pointer before using it

Vasiliy Kulikov (2):
      econet: 4 byte infoleak to the network
      netfilter: ipt_CLUSTERIP: fix buffer overflow

 drivers/net/bonding/bond_main.c                |    2 +-
 drivers/net/ftmac100.c                         |    2 +-
 drivers/net/gianfar.c                          |   16 ++-
 drivers/net/gianfar.h                          |    1 +
 drivers/net/niu.c                              |    2 +-
 drivers/net/r8169.c                            |    4 +-
 drivers/vhost/net.c                            |  159 ++++--------------------
 drivers/vhost/vhost.c                          |   55 ++++++---
 include/linux/ethtool.h                        |   34 +++++
 include/linux/if_ppp.h                         |   16 ++--
 include/linux/netfilter/ipset/ip_set_getport.h |   10 ++
 include/linux/netfilter/nfnetlink_log.h        |    4 +-
 include/linux/netfilter/nfnetlink_queue.h      |    4 +-
 include/linux/netfilter/xt_connbytes.h         |    4 +-
 include/linux/netfilter/xt_quota.h             |    2 +-
 net/8021q/vlan_dev.c                           |    1 +
 net/bridge/br_netfilter.c                      |    3 +
 net/core/ethtool.c                             |    3 +
 net/econet/af_econet.c                         |    2 +-
 net/ipv4/netfilter/ip_tables.c                 |    4 +-
 net/ipv4/netfilter/ipt_CLUSTERIP.c             |    5 +-
 net/ipv6/netfilter/ip6_tables.c                |    4 +-
 net/netfilter/ipset/ip_set_core.c              |   22 +++-
 net/netfilter/ipset/ip_set_hash_ipport.c       |   34 ++----
 net/netfilter/ipset/ip_set_hash_ipportip.c     |   34 ++----
 net/netfilter/ipset/ip_set_hash_ipportnet.c    |   34 ++----
 net/netfilter/ipset/ip_set_hash_netport.c      |   30 ++----
 net/socket.c                                   |  114 ++++++++++++++++-
 28 files changed, 321 insertions(+), 284 deletions(-)

[held lock freed] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-21 12:53:35

Dave,

lockdep caught this held-lock-freed incident in the networking code:

[   21.121321] EXT3-fs (sda5): using internal journal
[   21.127218] EXT3-fs (sda5): mounted filesystem with ordered data mode
[   22.034265] rc.sysinit used greatest stack depth: 5796 bytes left
[   22.511213] IPv4 FIB: Using LC-trie version 0.409
[   22.646483] 
[   22.646484] =========================
[   22.648398] [ BUG: held lock freed! ]
[   22.648398] -------------------------
[   22.648398] ifconfig/329 is freeing memory f5d01680-f5d018ff, with a lock still held there!
[   22.648398]  (sk_lock-AF_IPX){......}, at: [<c1c345b1>] ipx_release+0x21/0xf0
[   22.648398] 1 lock held by ifconfig/329:
[   22.648398]  #0:  (sk_lock-AF_IPX){......}, at: [<c1c345b1>] ipx_release+0x21/0xf0
[   22.648398] 
[   22.648398] stack backtrace:
[   22.648398] Pid: 329, comm: ifconfig Not tainted 2.6.38-tip+ #109381
[   22.648398] Call Trace:
[   22.648398]  [<c1d3dd48>] ? printk+0x2d/0x2f
[   22.648398]  [<c1067aab>] debug_check_no_locks_freed+0x10b/0x130
[   22.648398]  [<c10eae01>] kmem_cache_free+0x61/0x120
[   22.648398]  [<c1b1135c>] ? __sk_free+0xbc/0x150
[   22.648398]  [<c1b1135c>] __sk_free+0xbc/0x150
[   22.648398]  [<c1b17964>] ? skb_dequeue+0x44/0x60
[   22.648398]  [<c1b11ee5>] sk_free+0x25/0x30
[   22.648398]  [<c1c34647>] ipx_release+0xb7/0xf0
[   22.648398]  [<c1b0e386>] sock_release+0x16/0x60
[   22.648398]  [<c1b0e3e5>] sock_close+0x15/0x30
[   22.648398]  [<c1b0e3d0>] ? sock_close+0x0/0x30
[   22.648398]  [<c10f33cc>] fput+0xcc/0x260
[   22.648398]  [<c10f112a>] filp_close+0x4a/0x80
[   22.648398]  [<c103a7c6>] put_files_struct+0x146/0x170
[   22.648398]  [<c103a6b0>] ? put_files_struct+0x30/0x170
[   22.648398]  [<c103a87c>] exit_files+0x3c/0x50
[   22.648398]  [<c103abac>] do_exit+0x10c/0x770
[   22.648398]  [<c10f1d50>] ? vfs_write+0xf0/0x160
[   22.648398]  [<c10f1b80>] ? do_sync_write+0x0/0xe0
[   22.648398]  [<c103b284>] do_group_exit+0x34/0x90
[   22.648398]  [<c103b2f8>] sys_exit_group+0x18/0x20
[   22.648398]  [<c1d52597>] sysenter_do_call+0x12/0x32

Not sure whether it's VFS or networking related - my guess it's the latter.
The bug was introduced between 016aa2ed1cc9 and a44f99c7efdb.

The box has booted up fine after the lockdep report. Config attached.

Thanks,

	Ingo

Re: [held lock freed] Re: [GIT] Networking

From: Eric Dumazet <hidden>
Date: 2011-03-21 13:32:48

Le lundi 21 mars 2011 à 13:53 +0100, Ingo Molnar a écrit :
Dave,

lockdep caught this held-lock-freed incident in the networking code:

[   21.121321] EXT3-fs (sda5): using internal journal
[   21.127218] EXT3-fs (sda5): mounted filesystem with ordered data mode
[   22.034265] rc.sysinit used greatest stack depth: 5796 bytes left
[   22.511213] IPv4 FIB: Using LC-trie version 0.409
[   22.646483] 
[   22.646484] =========================
[   22.648398] [ BUG: held lock freed! ]
[   22.648398] -------------------------
[   22.648398] ifconfig/329 is freeing memory f5d01680-f5d018ff, with a lock still held there!
[   22.648398]  (sk_lock-AF_IPX){......}, at: [<c1c345b1>] ipx_release+0x21/0xf0
[   22.648398] 1 lock held by ifconfig/329:
[   22.648398]  #0:  (sk_lock-AF_IPX){......}, at: [<c1c345b1>] ipx_release+0x21/0xf0
[   22.648398] 
[   22.648398] stack backtrace:
[   22.648398] Pid: 329, comm: ifconfig Not tainted 2.6.38-tip+ #109381
[   22.648398] Call Trace:
[   22.648398]  [<c1d3dd48>] ? printk+0x2d/0x2f
[   22.648398]  [<c1067aab>] debug_check_no_locks_freed+0x10b/0x130
[   22.648398]  [<c10eae01>] kmem_cache_free+0x61/0x120
[   22.648398]  [<c1b1135c>] ? __sk_free+0xbc/0x150
[   22.648398]  [<c1b1135c>] __sk_free+0xbc/0x150
[   22.648398]  [<c1b17964>] ? skb_dequeue+0x44/0x60
[   22.648398]  [<c1b11ee5>] sk_free+0x25/0x30
[   22.648398]  [<c1c34647>] ipx_release+0xb7/0xf0
[   22.648398]  [<c1b0e386>] sock_release+0x16/0x60
[   22.648398]  [<c1b0e3e5>] sock_close+0x15/0x30
[   22.648398]  [<c1b0e3d0>] ? sock_close+0x0/0x30
[   22.648398]  [<c10f33cc>] fput+0xcc/0x260
[   22.648398]  [<c10f112a>] filp_close+0x4a/0x80
[   22.648398]  [<c103a7c6>] put_files_struct+0x146/0x170
[   22.648398]  [<c103a6b0>] ? put_files_struct+0x30/0x170
[   22.648398]  [<c103a87c>] exit_files+0x3c/0x50
[   22.648398]  [<c103abac>] do_exit+0x10c/0x770
[   22.648398]  [<c10f1d50>] ? vfs_write+0xf0/0x160
[   22.648398]  [<c10f1b80>] ? do_sync_write+0x0/0xe0
[   22.648398]  [<c103b284>] do_group_exit+0x34/0x90
[   22.648398]  [<c103b2f8>] sys_exit_group+0x18/0x20
[   22.648398]  [<c1d52597>] sysenter_do_call+0x12/0x32

Not sure whether it's VFS or networking related - my guess it's the latter.
The bug was introduced between 016aa2ed1cc9 and a44f99c7efdb.

The box has booted up fine after the lockdep report. Config attached.
Hi Ingo, thanks for this report.

Here is a probable fix.

[PATCH] ipx: fix ipx_release()

Commit b0d0d915d1d1a0 (remove the BKL) added a regression, because
sock_put() can free memory while we are going to use it later.

Fix is to delay sock_put() _after_ release_sock().

Reported-by: Ingo Molnar <redacted>
Signed-off-by: Eric Dumazet <redacted>
Cc: Arnd Bergmann <arnd@arndb.de>
---
 net/ipx/af_ipx.c |    2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/net/ipx/af_ipx.c b/net/ipx/af_ipx.c
index 2731b51..9680226 100644
--- a/net/ipx/af_ipx.c
+++ b/net/ipx/af_ipx.c
@@ -148,7 +148,6 @@ static void ipx_destroy_socket(struct sock *sk)
 	ipx_remove_socket(sk);
 	skb_queue_purge(&sk->sk_receive_queue);
 	sk_refcnt_debug_dec(sk);
-	sock_put(sk);
 }
 
 /*
@@ -1404,6 +1403,7 @@ static int ipx_release(struct socket *sock)
 	sk_refcnt_debug_release(sk);
 	ipx_destroy_socket(sk);
 	release_sock(sk);
+	sock_put(sk);
 out:
 	return 0;
 }

Re: [held lock freed] Re: [GIT] Networking

From: Arnd Bergmann <arnd@arndb.de>
Date: 2011-03-21 14:50:18

On Monday 21 March 2011, Eric Dumazet wrote:
[PATCH] ipx: fix ipx_release()

Commit b0d0d915d1d1a0 (remove the BKL) added a regression, because
sock_put() can free memory while we are going to use it later.

Fix is to delay sock_put() after release_sock().

Reported-by: Ingo Molnar <redacted>
Signed-off-by: Eric Dumazet <redacted>
Cc: Arnd Bergmann <arnd@arndb.de>
Your fix looks good, thanks Eric!

Acked-by: Arnd Bergmann <arnd@arndb.de>

I believe I made the same mistake in atalk_release and x25_release:

8<------------
net: fix atalk_release and x25_release

The recent BKL removal has introduced a use-after-free problem
in multiple network protocols. This fixes the problem in appletalk
and x25 by ensuring that we call the final sock_put() after
releasing the socket lock.

Signed-off-by: Arnd Bergmann <arnd@arndb.de>
diff --git a/net/appletalk/ddp.c b/net/appletalk/ddp.c
index 3d4f4b0..206e771 100644
--- a/net/appletalk/ddp.c
+++ b/net/appletalk/ddp.c
@@ -1051,6 +1051,7 @@ static int atalk_release(struct socket *sock)
 {
 	struct sock *sk = sock->sk;
 
+	sock_hold(sk);
 	lock_sock(sk);
 	if (sk) {
 		sock_orphan(sk);
@@ -1058,6 +1059,8 @@ static int atalk_release(struct socket *sock)
 		atalk_destroy_socket(sk);
 	}
 	release_sock(sk);
+	sock_put(sk);
+
 	return 0;
 }
 
diff --git a/net/x25/af_x25.c b/net/x25/af_x25.c
index 4680b1e..b2cf1db 100644
--- a/net/x25/af_x25.c
+++ b/net/x25/af_x25.c
@@ -669,8 +669,8 @@ static int x25_release(struct socket *sock)
 
 	sock_orphan(sk);
 out:
-	release_sock(sk);
 	sock_put(sk);
+	release_sock(sk);
 	return 0;
 }
 

Re: [held lock freed] Re: [GIT] Networking

From: Eric Dumazet <hidden>
Date: 2011-03-21 14:56:19

Le lundi 21 mars 2011 à 15:50 +0100, Arnd Bergmann a écrit :
On Monday 21 March 2011, Eric Dumazet wrote:
quoted
[PATCH] ipx: fix ipx_release()

Commit b0d0d915d1d1a0 (remove the BKL) added a regression, because
sock_put() can free memory while we are going to use it later.

Fix is to delay sock_put() after release_sock().

Reported-by: Ingo Molnar <redacted>
Signed-off-by: Eric Dumazet <redacted>
Cc: Arnd Bergmann <arnd@arndb.de>
Your fix looks good, thanks Eric!

Acked-by: Arnd Bergmann <arnd@arndb.de>

I believe I made the same mistake in atalk_release and x25_release:

8<------------
net: fix atalk_release and x25_release

The recent BKL removal has introduced a use-after-free problem
in multiple network protocols. This fixes the problem in appletalk
and x25 by ensuring that we call the final sock_put() after
releasing the socket lock.

Signed-off-by: Arnd Bergmann <arnd@arndb.de>
quoted hunk
diff --git a/net/x25/af_x25.c b/net/x25/af_x25.c
index 4680b1e..b2cf1db 100644
--- a/net/x25/af_x25.c
+++ b/net/x25/af_x25.c
@@ -669,8 +669,8 @@ static int x25_release(struct socket *sock)
 
 	sock_orphan(sk);
 out:
-	release_sock(sk);
 	sock_put(sk);
+	release_sock(sk);
 	return 0;
 }
 
Hmm, x25_release() looks fine, I believe no fix is needed.



Re: [held lock freed] Re: [GIT] Networking

From: Arnd Bergmann <arnd@arndb.de>
Date: 2011-03-21 15:22:48

On Monday 21 March 2011, Eric Dumazet wrote:
quoted
diff --git a/net/x25/af_x25.c b/net/x25/af_x25.c
index 4680b1e..b2cf1db 100644
--- a/net/x25/af_x25.c
+++ b/net/x25/af_x25.c
@@ -669,8 +669,8 @@ static int x25_release(struct socket *sock)
 
      sock_orphan(sk);
 out:
-     release_sock(sk);
      sock_put(sk);
+     release_sock(sk);
      return 0;
 }
 
Hmm, x25_release() looks fine, I believe no fix is needed.
D'oh. You're right of course. My patch would introduce the bug,
not fix it. Updated patch below.

	Arnd
8<-------------------------
net/appletalk: fix atalk_release use after free

The BKL removal in appletalk introduced a use-after-free problem,
where atalk_destroy_socket frees a sock, but we still release
the socket lock on it.

An easy fix is to take an extra reference on the sock and sock_put
it when returning from atalk_release.

Signed-off-by: Arnd Bergmann <arnd@arndb.de>

index 3d4f4b0..206e771 100644
--- a/net/appletalk/ddp.c
+++ b/net/appletalk/ddp.c
@@ -1051,6 +1051,7 @@ static int atalk_release(struct socket *sock)
 {
 	struct sock *sk = sock->sk;
 
+	sock_hold(sk);
 	lock_sock(sk);
 	if (sk) {
 		sock_orphan(sk);
@@ -1058,6 +1059,8 @@ static int atalk_release(struct socket *sock)
 		atalk_destroy_socket(sk);
 	}
 	release_sock(sk);
+	sock_put(sk);
+
 	return 0;
 }
 

Re: [held lock freed] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-21 16:15:42

* Eric Dumazet [off-list ref] wrote:
Here is a probable fix.

[PATCH] ipx: fix ipx_release()
This patch did the trick - thanks Eric!

Tested-by: Ingo Molnar <redacted>

	Ingo

Re: [held lock freed] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-21 16:16:34

* Arnd Bergmann [off-list ref] wrote:
quoted hunk
On Monday 21 March 2011, Eric Dumazet wrote:
quoted
quoted
diff --git a/net/x25/af_x25.c b/net/x25/af_x25.c
index 4680b1e..b2cf1db 100644
--- a/net/x25/af_x25.c
+++ b/net/x25/af_x25.c
@@ -669,8 +669,8 @@ static int x25_release(struct socket *sock)
 
      sock_orphan(sk);
 out:
-     release_sock(sk);
      sock_put(sk);
+     release_sock(sk);
      return 0;
 }
 
Hmm, x25_release() looks fine, I believe no fix is needed.
D'oh. You're right of course. My patch would introduce the bug,
not fix it. Updated patch below.

	Arnd
8<-------------------------
net/appletalk: fix atalk_release use after free

The BKL removal in appletalk introduced a use-after-free problem,
where atalk_destroy_socket frees a sock, but we still release
the socket lock on it.

An easy fix is to take an extra reference on the sock and sock_put
it when returning from atalk_release.

Signed-off-by: Arnd Bergmann <arnd@arndb.de>

index 3d4f4b0..206e771 100644
--- a/net/appletalk/ddp.c
+++ b/net/appletalk/ddp.c
@@ -1051,6 +1051,7 @@ static int atalk_release(struct socket *sock)
 {
 	struct sock *sk = sock->sk;
 
+	sock_hold(sk);
 	lock_sock(sk);
 	if (sk) {
 		sock_orphan(sk);
@@ -1058,6 +1059,8 @@ static int atalk_release(struct socket *sock)
 		atalk_destroy_socket(sk);
 	}
 	release_sock(sk);
+	sock_put(sk);
+
 	return 0;
 }
I have not triggered the lockdep warning in this code yet - but i've ran the 
patch and have seen no ill effects from it so far.

Thanks,

	Ingo

[slab poison overwritten] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-21 16:43:40

I'm getting this memory corruption warning:

   BUG kmalloc-1024: Poison overwritten

Note, it's not fully proven that it's caused by networking - but in a previous 
bootup (unfortunately the logs are not available) i got this warning straight 
after netfilter initialized.

As far as i can remember it came shortly after these messages:

 calling  tunnel4_init+0x0/0x63 @ 1
 initcall tunnel4_init+0x0/0x63 returned 0 after 2 usecs
 calling  ipv4_netfilter_init+0x0/0x10 @ 1
 initcall ipv4_netfilter_init+0x0/0x10 returned 0 after 2 usecs
 calling  ip_tables_init+0x0/0x8d @ 1
 ip_tables: (C) 2000-2006 Netfilter Core Team

Full message is below - the backtrace there is a benign tty alloc.

Thanks,

	Ingo

-------------->
EXT3-fs (sda1): mounted filesystem with ordered data mode
VFS: Mounted root (ext3 filesystem) readonly on device 8:1.
async_waiting @ 1
async_continuing @ 1 after 1 usec
Freeing unused kernel memory: 420k freed
Not activating Mandatory Access Control now since /sbin/tomoyo-init doesn't exist.
=============================================================================
BUG kmalloc-1024: Poison overwritten
-----------------------------------------------------------------------------

INFO: 0xbd4e1c04-0xbd4e1c0f. First byte 0x0 instead of 0x6b
INFO: Allocated in ops_init.constprop.5+0x4a/0xe0 age=1537 cpu=0 pid=1
INFO: Freed in ops_free+0x2a/0x30 age=1233 cpu=1 pid=1
INFO: Slab 0xbf817c00 objects=15 used=6 fp=0xbd4e1920 flags=0x3d0040c1
INFO: Object 0xbd4e1920 @offset=6432 fp=0xbd4e1d50

Bytes b4 0xbd4e1910:  4a 00 00 00 c3 84 fb ff 5a 5a 5a 5a 5a 5a 5a 5a J...�.��ZZZZZZZZ
  Object 0xbd4e1920:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1930:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1940:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1950:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1960:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1970:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1980:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1990:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e19a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e19b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e19c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e19d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e19e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e19f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a80:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1a90:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1aa0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ab0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ac0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ad0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ae0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1af0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b80:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1b90:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ba0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1bb0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1bc0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1bd0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1be0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1bf0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c00:  6b 6b 6b 6b 00 5c 26 05 80 71 54 bd 80 14 c1 81 kkkk.\&..qT�..�.
  Object 0xbd4e1c10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c80:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1c90:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ca0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1cb0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1cc0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1cd0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1ce0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1cf0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1d00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd4e1d10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
 Redzone 0xbd4e1d20:  bb bb bb bb                                     ����            
 Padding 0xbd4e1d48:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
Pid: 86, comm: init Not tainted 2.6.38-tip-08705-g112440a-dirty #109442
Call Trace:
 [<8109919b>] print_trailer+0xab/0x110
 [<8109932c>] check_bytes_and_report+0xdc/0x120
 [<8109a04b>] check_object+0x1db/0x230
 [<81098dbb>] ? check_valid_pointer+0x2b/0x60
 [<818bb338>] alloc_debug_processing+0x74/0xf2
 [<818bb878>] __slab_alloc.constprop.18+0x1a3/0x1fd
 [<8137c57e>] ? alloc_tty_struct+0x1e/0x20
 [<8137c57e>] ? alloc_tty_struct+0x1e/0x20
 [<8109ac11>] kmem_cache_alloc+0x81/0x90
 [<8137c57e>] alloc_tty_struct+0x1e/0x20
 [<8137de6b>] tty_init_dev+0xcb/0x160
 [<810307d2>] ? console_device+0x42/0x50
 [<8137ee14>] tty_open+0x304/0x4d0
 [<810a64d8>] chrdev_open+0x68/0x130
 [<810a1422>] __dentry_open+0xe2/0x230
 [<810a2446>] nameidata_to_filp+0x66/0x80
 [<810a6470>] ? chrdev_open+0x0/0x130
 [<810ae145>] do_last+0x315/0x7d0
 [<810ae698>] path_openat+0x98/0x340
 [<810ae999>] do_filp_open+0x59/0x80
 [<810b9bd4>] ? alloc_fd+0x34/0xe0
 [<810ab934>] ? getname_flags+0xa4/0xe0
 [<810a2861>] do_sys_open+0xe1/0x1b0
 [<810a2959>] sys_open+0x29/0x40
 [<818c8b57>] sysenter_do_call+0x12/0x26
FIX kmalloc-1024: Restoring 0xbd4e1c04-0xbd4e1c0f=0x6b

FIX kmalloc-1024: Marking all objects used
sd 0:0:0:0: rpm_resume flags 0x4
sd 0:0:0:0: rpm_resume returns 1
sd 0:0:0:0: rpm_resume flags 0x4

	Ingo

Re: [slab poison overwritten] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-21 17:38:17

* Ingo Molnar [off-list ref] wrote:
I'm getting this memory corruption warning:

   BUG kmalloc-1024: Poison overwritten
Find another one below - this seems to trigger closer to the corruption site.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control.
[    9.615628] initcall 0xffffffff81d5b9da returned -12 after 22784 usecs
[    9.618960] initcall 0xffffffff81d5b9da returned with error code -12 
[    9.622291] calling  0xffffffff81d5c0c0 @ 1
[    9.625625] IPVS: [wlc] scheduler registered.
[    9.628957] initcall 0xffffffff81d5c0c0 returned 0 after 3254 usecs
[    9.632291] calling  0xffffffff81d5c12b @ 1
[    9.635635] IPVS: [lblc] scheduler registered.
[    9.638957] initcall 0xffffffff81d5c12b returned 0 after 3254 usecs
[    9.642290] calling  0xffffffff81d5c167 @ 1
[    9.645623] IPVS: [dh] scheduler registered.
[    9.648956] initcall 0xffffffff81d5c167 returned 0 after 3254 usecs
[    9.652289] calling  0xffffffff81d5c179 @ 1
[    9.655622] IPVS: [sh] scheduler registered.
[    9.658955] initcall 0xffffffff81d5c179 returned 0 after 3254 usecs
[    9.662289] calling  0xffffffff81d5c18b @ 1
[    9.668955] IPVS: [nq] scheduler registered.
[    9.672288] initcall 0xffffffff81d5c18b returned 0 after 3254 usecs
[    9.676859] calling  0xffffffff81d5d589 @ 1
[    9.679217] initcall 0xffffffff81d5d589 returned 0 after 0 usecs
[    9.682288] calling  0xffffffff81d5d9fa @ 1
[    9.685620] IPv4 over IPv4 tunneling driver
[    9.689135] =============================================================================
[    9.692285] BUG kmalloc-2048: Poison overwritten
[    9.692285] -----------------------------------------------------------------------------
[    9.692285] 
[    9.692285] INFO: 0xffff88003cc2d6c0-0xffff88003cc2d6d7. First byte 0x0 instead of 0x6b
[    9.692285] INFO: Allocated in 0xffffffff8178ad5c age=29 cpu=0 pid=1
[    9.692285] INFO: Freed in 0xffffffff8178ac6c age=23 cpu=0 pid=1
[    9.692285] INFO: Slab 0xffffea0000d4a8c0 objects=15 used=11 fp=0xffff88003cc2d2d0 flags=0x40000000000040c0
[    9.692285] INFO: Object 0xffff88003cc2d2d0 @offset=21200 fp=0xffff88003cc2e360
[    9.692285] 
[    9.692285] Bytes b4 0xffff88003cc2d2c0:  00 00 00 00 00 00 00 00 5a 5a 5a 5a 5a 5a 5a 5a ........ZZZZZZZZ
[    9.692285]   Object 0xffff88003cc2d2d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d2e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d2f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d300:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d310:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d320:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d330:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d340:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d350:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d360:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d370:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d380:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d390:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d400:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d410:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d420:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d430:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d440:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d450:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d460:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d470:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d480:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d490:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d500:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d510:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d520:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d530:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d540:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d550:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d560:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d570:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d580:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d590:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d600:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d610:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d620:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d630:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d640:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d650:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d660:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d670:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d680:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d690:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6c0:  00 82 8b 01 6b 6b 6b 6b 48 82 cb 3c 00 88 ff ff ....kkkkH.�<..��
[    9.692285]   Object 0xffff88003cc2d6d0:  60 ae d0 81 ff ff ff ff 6b 6b 6b 6b 6b 6b 6b 6b `��.����kkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d700:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d710:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d720:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d730:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d740:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d750:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d760:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d770:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d780:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d790:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d800:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d810:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d820:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d830:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d840:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d850:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d860:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d870:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d880:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d890:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d900:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d910:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d920:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d930:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d940:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d950:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d960:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d970:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d980:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d990:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da80:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da90:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2daa0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2dab0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2dac0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
[    9.692285]  Redzone 0xffff88003cc2dad0:  bb bb bb bb bb bb bb bb                         ��������        
[    9.692285]  Padding 0xffff88003cc2db10:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
[    9.692285] Pid: 1, comm: swapper Not tainted 2.6.38-tip-08708-g9ad1933-dirty #109455
[    9.692285] Call Trace:
[    9.692285]  [<ffffffff810c3c3c>] 0xffffffff810c3c3c
[    9.692285]  [<ffffffff810c3f0f>] 0xffffffff810c3f0f
[    9.692285]  [<ffffffff81798fbb>] ? 0xffffffff81798fbb
[    9.692285]  [<ffffffff810c400c>] 0xffffffff810c400c
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff8193dbb7>] 0xffffffff8193dbb7
[    9.692285]  [<ffffffff8193e253>] 0xffffffff8193e253
[    9.692285]  [<ffffffff810c63bd>] 0xffffffff810c63bd
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff810aba3e>] 0xffffffff810aba3e
[    9.692285]  [<ffffffff81798f31>] 0xffffffff81798f31
[    9.692285]  [<ffffffff81821593>] 0xffffffff81821593
[    9.692285]  [<ffffffff81821675>] 0xffffffff81821675
[    9.692285]  [<ffffffff81821d40>] 0xffffffff81821d40
[    9.692285]  [<ffffffff8136ad34>] ? 0xffffffff8136ad34
[    9.692285]  [<ffffffff81072568>] 0xffffffff81072568
[    9.692285]  [<ffffffff81072832>] 0xffffffff81072832
[    9.692285]  [<ffffffff8178c87b>] 0xffffffff8178c87b
[    9.692285]  [<ffffffff817913db>] 0xffffffff817913db
[    9.692285]  [<ffffffff8179147e>] 0xffffffff8179147e
[    9.692285]  [<ffffffff81d5d9d8>] 0xffffffff81d5d9d8
[    9.692285]  [<ffffffff8178ae06>] 0xffffffff8178ae06
[    9.692285]  [<ffffffff81d5d9fa>] ? 0xffffffff81d5d9fa
[    9.692285]  [<ffffffff81d5d9fa>] ? 0xffffffff81d5d9fa
[    9.692285]  [<ffffffff8178ae65>] 0xffffffff8178ae65
[    9.692285]  [<ffffffff8194c949>] ? 0xffffffff8194c949
[    9.692285]  [<ffffffff8178af96>] 0xffffffff8178af96
[    9.692285]  [<ffffffff81d5da1b>] 0xffffffff81d5da1b
[    9.692285]  [<ffffffff81d25aee>] 0xffffffff81d25aee
[    9.692285]  [<ffffffff81d25c76>] 0xffffffff81d25c76
[    9.692285]  [<ffffffff8194ea44>] 0xffffffff8194ea44
[    9.692285]  [<ffffffff81d25bcf>] ? 0xffffffff81d25bcf
[    9.692285]  [<ffffffff8194ea40>] ? 0xffffffff8194ea40
[    9.692285] FIX kmalloc-2048: Restoring 0xffff88003cc2d6c0-0xffff88003cc2d6d7=0x6b
[    9.692285] 
[    9.692285] FIX kmalloc-2048: Marking all objects used
[    9.692586] initcall 0xffffffff81d5d9fa returned 0 after 6509 usecs
[    9.695620] calling  0xffffffff81d5da59 @ 1
[    9.698952] GRE over IPv4 demultiplexor driver
[    9.702287] initcall 0xffffffff81d5da59 returned 0 after 3254 usecs
[    9.705619] calling  0xffffffff81d5da99 @ 1
[    9.708953] initcall 0xffffffff81d5da99 returned 0 after 0 usecs
[    9.712285] calling  0xffffffff81d5db01 @ 1
[    9.715619] initcall 0xffffffff81d5db01 returned 0 after 0 usecs
[    9.718951] calling  0xffffffff81d5db33 @ 1
[    9.722285] initcall 0xffffffff81d5db33 returned 0 after 0 usecs
[    9.725618] calling  0xffffffff81d5db4a @ 1
[    9.728951] initcall 0xffffffff81d5db4a returned 0 after 0 usecs
[    9.732284] calling  0xffffffff8183391a @ 1
[    9.735618] initcall 0xffffffff8183391a returned 0 after 0 usecs
[    9.738950] calling  0xffffffff81d5f616 @ 1
[    9.742383] initcall 0xffffffff81d5f616 returned 0 after 0 usecs
[    9.745616] calling  0xffffffff81d5f777 @ 1
[    9.748986] initcall 0xffffffff81d5f777 returned 0 after 0 usecs
[    9.752283] calling  0xffffffff81d5f895 @ 1
[    9.755616] initcall 0xffffffff81d5f895 returned 0 after 0 usecs
[    9.758949] calling  0xffffffff81d5f8ac @ 1
[    9.762283] initcall 0xffffffff81d5f8ac returned 0 after 0 usecs
[    9.765615] calling  0xffffffff81d5f8be @ 1
[    9.768948] initcall 0xffffffff81d5f8be returned 0 after 0 usecs
[    9.772281] calling  0xffffffff81d5f8e0 @ 1
[    9.775634] ip_tables: (C) 2000-2006 Netfilter Core Team
[    9.778948] initcall 0xffffffff81d5f8e0 returned 0 after 3254 usecs
[    9.782281] calling  0xffffffff81d5f9e6 @ 1
[    9.785650] initcall 0xffffffff81d5f9e6 returned 0 after 0 usecs
[    9.788947] calling  0xffffffff81d5faee @ 1
[    9.792304] initcall 0xffffffff81d5faee returned 0 after 0 usecs
[    9.795613] calling  0xffffffff81d5fbc7 @ 1
[    9.798970] initcall 0xffffffff81d5fbc7 returned 0 after 0 usecs
[    9.802280] calling  0xffffffff81d5fc15 @ 1
[    9.805613] initcall 0xffffffff81d5fc15 returned 0 after 0 usecs
[    9.808946] calling  0xffffffff81d5fc27 @ 1
[    9.812285] ipt_CLUSTERIP: ClusterIP Version 0.8 loaded successfully
[    9.815612] initcall 0xffffffff81d5fc27 returned 0 after 3254 usecs
[    9.818945] calling  0xffffffff81d5fcba @ 1
[    9.822281] initcall 0xffffffff81d5fcba returned 0 after 0 usecs
[    9.825611] calling  0xffffffff81d5fcf2 @ 1
[    9.828967] initcall 0xffffffff81d5fcf2 returned 0 after 0 usecs
[    9.832278] calling  0xffffffff81d5fd67 @ 1
[    9.835611] initcall 0xffffffff81d5fd67 returned 0 after 0 usecs
[    9.838944] calling  0xffffffff81d5fd79 @ 1
[    9.842278] TCP westwood registered
[    9.845610] initcall 0xffffffff81d5fd79 returned 0 after 3254 usecs

Re: [slab poison overwritten] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-21 17:40:33

here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control.
[    9.615628] initcall 0xffffffff81d5b9da returned -12 after 22784 usecs
[    9.618960] initcall 0xffffffff81d5b9da returned with error code -12 
[    9.622291] calling  0xffffffff81d5c0c0 @ 1
[    9.625625] IPVS: [wlc] scheduler registered.
[    9.628957] initcall 0xffffffff81d5c0c0 returned 0 after 3254 usecs
[    9.632291] calling  0xffffffff81d5c12b @ 1
[    9.635635] IPVS: [lblc] scheduler registered.
[    9.638957] initcall 0xffffffff81d5c12b returned 0 after 3254 usecs
[    9.642290] calling  0xffffffff81d5c167 @ 1
[    9.645623] IPVS: [dh] scheduler registered.
[    9.648956] initcall 0xffffffff81d5c167 returned 0 after 3254 usecs
[    9.652289] calling  0xffffffff81d5c179 @ 1
[    9.655622] IPVS: [sh] scheduler registered.
[    9.658955] initcall 0xffffffff81d5c179 returned 0 after 3254 usecs
[    9.662289] calling  0xffffffff81d5c18b @ 1
[    9.668955] IPVS: [nq] scheduler registered.
[    9.672288] initcall 0xffffffff81d5c18b returned 0 after 3254 usecs
[    9.676859] calling  0xffffffff81d5d589 @ 1
[    9.679217] initcall 0xffffffff81d5d589 returned 0 after 0 usecs
[    9.682288] calling  0xffffffff81d5d9fa @ 1
[    9.685620] IPv4 over IPv4 tunneling driver
[    9.689135] =============================================================================
[    9.692285] BUG kmalloc-2048: Poison overwritten
[    9.692285] -----------------------------------------------------------------------------
[    9.692285] 
[    9.692285] INFO: 0xffff88003cc2d6c0-0xffff88003cc2d6d7. First byte 0x0 instead of 0x6b
[    9.692285] INFO: Allocated in 0xffffffff8178ad5c age=29 cpu=0 pid=1
[    9.692285] INFO: Freed in 0xffffffff8178ac6c age=23 cpu=0 pid=1
[    9.692285] INFO: Slab 0xffffea0000d4a8c0 objects=15 used=11 fp=0xffff88003cc2d2d0 flags=0x40000000000040c0
[    9.692285] INFO: Object 0xffff88003cc2d2d0 @offset=21200 fp=0xffff88003cc2e360
[    9.692285] 
[    9.692285] Bytes b4 0xffff88003cc2d2c0:  00 00 00 00 00 00 00 00 5a 5a 5a 5a 5a 5a 5a 5a ........ZZZZZZZZ
[    9.692285]   Object 0xffff88003cc2d2d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d2e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d2f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d300:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d310:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d320:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d330:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d340:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d350:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d360:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d370:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d380:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d390:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d3f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d400:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d410:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d420:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d430:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d440:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d450:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d460:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d470:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d480:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d490:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d4f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d500:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d510:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d520:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d530:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d540:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d550:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d560:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d570:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d580:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d590:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d5f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d600:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d610:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d620:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d630:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d640:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d650:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d660:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d670:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d680:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d690:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6c0:  00 82 8b 01 6b 6b 6b 6b 48 82 cb 3c 00 88 ff ff ....kkkkH.�<..��
[    9.692285]   Object 0xffff88003cc2d6d0:  60 ae d0 81 ff ff ff ff 6b 6b 6b 6b 6b 6b 6b 6b `��.����kkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d6f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d700:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d710:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d720:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d730:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d740:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d750:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d760:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d770:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d780:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d790:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d7f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d800:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d810:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d820:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d830:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d840:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d850:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d860:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d870:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d880:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d890:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d8f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d900:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d910:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d920:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d930:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d940:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d950:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d960:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d970:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d980:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d990:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2d9f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da00:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da10:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da20:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da30:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da40:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da50:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da60:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da70:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da80:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2da90:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2daa0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2dab0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
[    9.692285]   Object 0xffff88003cc2dac0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
[    9.692285]  Redzone 0xffff88003cc2dad0:  bb bb bb bb bb bb bb bb                         ��������        
[    9.692285]  Padding 0xffff88003cc2db10:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
[    9.692285] Pid: 1, comm: swapper Not tainted 2.6.38-tip-08708-g9ad1933-dirty #109455
[    9.692285] Call Trace:
[    9.692285]  [<ffffffff810c3c3c>] 0xffffffff810c3c3c
[    9.692285]  [<ffffffff810c3f0f>] 0xffffffff810c3f0f
[    9.692285]  [<ffffffff81798fbb>] ? 0xffffffff81798fbb
[    9.692285]  [<ffffffff810c400c>] 0xffffffff810c400c
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff8193dbb7>] 0xffffffff8193dbb7
[    9.692285]  [<ffffffff8193e253>] 0xffffffff8193e253
[    9.692285]  [<ffffffff810c63bd>] 0xffffffff810c63bd
[    9.692285]  [<ffffffff81798f31>] ? 0xffffffff81798f31
[    9.692285]  [<ffffffff810aba3e>] 0xffffffff810aba3e
[    9.692285]  [<ffffffff81798f31>] 0xffffffff81798f31
[    9.692285]  [<ffffffff81821593>] 0xffffffff81821593
[    9.692285]  [<ffffffff81821675>] 0xffffffff81821675
[    9.692285]  [<ffffffff81821d40>] 0xffffffff81821d40
[    9.692285]  [<ffffffff8136ad34>] ? 0xffffffff8136ad34
[    9.692285]  [<ffffffff81072568>] 0xffffffff81072568
[    9.692285]  [<ffffffff81072832>] 0xffffffff81072832
[    9.692285]  [<ffffffff8178c87b>] 0xffffffff8178c87b
[    9.692285]  [<ffffffff817913db>] 0xffffffff817913db
[    9.692285]  [<ffffffff8179147e>] 0xffffffff8179147e
[    9.692285]  [<ffffffff81d5d9d8>] 0xffffffff81d5d9d8
[    9.692285]  [<ffffffff8178ae06>] 0xffffffff8178ae06
[    9.692285]  [<ffffffff81d5d9fa>] ? 0xffffffff81d5d9fa
[    9.692285]  [<ffffffff81d5d9fa>] ? 0xffffffff81d5d9fa
[    9.692285]  [<ffffffff8178ae65>] 0xffffffff8178ae65
[    9.692285]  [<ffffffff8194c949>] ? 0xffffffff8194c949
[    9.692285]  [<ffffffff8178af96>] 0xffffffff8178af96
[    9.692285]  [<ffffffff81d5da1b>] 0xffffffff81d5da1b
[    9.692285]  [<ffffffff81d25aee>] 0xffffffff81d25aee
[    9.692285]  [<ffffffff81d25c76>] 0xffffffff81d25c76
[    9.692285]  [<ffffffff8194ea44>] 0xffffffff8194ea44
[    9.692285]  [<ffffffff81d25bcf>] ? 0xffffffff81d25bcf
[    9.692285]  [<ffffffff8194ea40>] ? 0xffffffff8194ea40
[    9.692285] FIX kmalloc-2048: Restoring 0xffff88003cc2d6c0-0xffff88003cc2d6d7=0x6b
[    9.692285] 
[    9.692285] FIX kmalloc-2048: Marking all objects used
[    9.692586] initcall 0xffffffff81d5d9fa returned 0 after 6509 usecs
[    9.695620] calling  0xffffffff81d5da59 @ 1
[    9.698952] GRE over IPv4 demultiplexor driver
[    9.702287] initcall 0xffffffff81d5da59 returned 0 after 3254 usecs
[    9.705619] calling  0xffffffff81d5da99 @ 1
[    9.708953] initcall 0xffffffff81d5da99 returned 0 after 0 usecs
[    9.712285] calling  0xffffffff81d5db01 @ 1
[    9.715619] initcall 0xffffffff81d5db01 returned 0 after 0 usecs
[    9.718951] calling  0xffffffff81d5db33 @ 1
[    9.722285] initcall 0xffffffff81d5db33 returned 0 after 0 usecs
[    9.725618] calling  0xffffffff81d5db4a @ 1
[    9.728951] initcall 0xffffffff81d5db4a returned 0 after 0 usecs
[    9.732284] calling  0xffffffff8183391a @ 1
[    9.735618] initcall 0xffffffff8183391a returned 0 after 0 usecs
[    9.738950] calling  0xffffffff81d5f616 @ 1
[    9.742383] initcall 0xffffffff81d5f616 returned 0 after 0 usecs
[    9.745616] calling  0xffffffff81d5f777 @ 1
[    9.748986] initcall 0xffffffff81d5f777 returned 0 after 0 usecs
[    9.752283] calling  0xffffffff81d5f895 @ 1
[    9.755616] initcall 0xffffffff81d5f895 returned 0 after 0 usecs
[    9.758949] calling  0xffffffff81d5f8ac @ 1
[    9.762283] initcall 0xffffffff81d5f8ac returned 0 after 0 usecs
[    9.765615] calling  0xffffffff81d5f8be @ 1
[    9.768948] initcall 0xffffffff81d5f8be returned 0 after 0 usecs
[    9.772281] calling  0xffffffff81d5f8e0 @ 1
[    9.775634] ip_tables: (C) 2000-2006 Netfilter Core Team
[    9.778948] initcall 0xffffffff81d5f8e0 returned 0 after 3254 usecs
[    9.782281] calling  0xffffffff81d5f9e6 @ 1
[    9.785650] initcall 0xffffffff81d5f9e6 returned 0 after 0 usecs
[    9.788947] calling  0xffffffff81d5faee @ 1
[    9.792304] initcall 0xffffffff81d5faee returned 0 after 0 usecs
[    9.795613] calling  0xffffffff81d5fbc7 @ 1
[    9.798970] initcall 0xffffffff81d5fbc7 returned 0 after 0 usecs
[    9.802280] calling  0xffffffff81d5fc15 @ 1
[    9.805613] initcall 0xffffffff81d5fc15 returned 0 after 0 usecs
[    9.808946] calling  0xffffffff81d5fc27 @ 1
[    9.812285] ipt_CLUSTERIP: ClusterIP Version 0.8 loaded successfully
[    9.815612] initcall 0xffffffff81d5fc27 returned 0 after 3254 usecs
[    9.818945] calling  0xffffffff81d5fcba @ 1
[    9.822281] initcall 0xffffffff81d5fcba returned 0 after 0 usecs
[    9.825611] calling  0xffffffff81d5fcf2 @ 1
[    9.828967] initcall 0xffffffff81d5fcf2 returned 0 after 0 usecs
[    9.832278] calling  0xffffffff81d5fd67 @ 1
[    9.835611] initcall 0xffffffff81d5fd67 returned 0 after 0 usecs
[    9.838944] calling  0xffffffff81d5fd79 @ 1
[    9.842278] TCP westwood registered
[    9.845610] initcall 0xffffffff81d5fd79 returned 0 after 3254 usecs

Re: [slab poison overwritten] Re: [GIT] Networking

From: Eric Dumazet <hidden>
Date: 2011-03-21 18:09:12

Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?

Re: [GIT] Networking

From: Linus Torvalds <torvalds@linux-foundation.org>
Date: 2011-03-21 19:24:37

On Sun, Mar 20, 2011 at 7:51 PM, David Miller [off-list ref] wrote:
1) The R8169 PHY fix from Eric Dumazet, which I see you've added to
  your tree too. :-)
Yeah, since my machine didn't have networking without it, and I could
test it myself, I didn't wait to pull.

That said, I'm delaying this pull request due to the known issues with
it - let me know when you've updated it with the fix for the
use-after-free fixes and the slab corruptor (the latter of which I
haven't seen a patch for yet)

                         Linus

Re: [GIT] Networking

From: Eric Dumazet <hidden>
Date: 2011-03-21 20:11:05

Le lundi 21 mars 2011 à 12:24 -0700, Linus Torvalds a écrit :
On Sun, Mar 20, 2011 at 7:51 PM, David Miller [off-list ref] wrote:
quoted
1) The R8169 PHY fix from Eric Dumazet, which I see you've added to
  your tree too. :-)
Yeah, since my machine didn't have networking without it, and I could
test it myself, I didn't wait to pull.

That said, I'm delaying this pull request due to the known issues with
it - let me know when you've updated it with the fix for the
use-after-free fixes and the slab corruptor (the latter of which I
haven't seen a patch for yet)
Seems to be related to one typo, but still we have to find the
corruption
diff --git a/net/netfilter/ipvs/ip_vs_ctl.c b/net/netfilter/ipvs/ip_vs_ctl.c
index b799cea..33733c8 100644
--- a/net/netfilter/ipvs/ip_vs_ctl.c
+++ b/net/netfilter/ipvs/ip_vs_ctl.c
@@ -3605,7 +3605,7 @@ int __net_init __ip_vs_control_init(struct net *net)
 
 	/* procfs stats */
 	ipvs->tot_stats.cpustats = alloc_percpu(struct ip_vs_cpu_stats);
-	if (ipvs->tot_stats.cpustats) {
+	if (!ipvs->tot_stats.cpustats) {
 		pr_err("%s(): alloc_percpu.\n", __func__);
 		return -ENOMEM;
 	}

Re: [slab poison overwritten] Re: [GIT] Networking

From: Eric Dumazet <hidden>
Date: 2011-03-21 20:16:38

Le lundi 21 mars 2011 à 19:07 +0100, Eric Dumazet a écrit :
Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
quoted
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?
For the time being, we can avoid the false memory allocation error (and
leak)

Thanks

[PATCH] ipvs: fix a typo in __ip_vs_control_init()

Reported-by: Ingo Molnar <redacted>
Signed-off-by: Eric Dumazet <redacted>
Cc: Simon Horman <horms@verge.net.au>
Cc: Julian Anastasov <ja@ssi.bg>
---
 net/netfilter/ipvs/ip_vs_ctl.c |    2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/net/netfilter/ipvs/ip_vs_ctl.c b/net/netfilter/ipvs/ip_vs_ctl.c
index b799cea..33733c8 100644
--- a/net/netfilter/ipvs/ip_vs_ctl.c
+++ b/net/netfilter/ipvs/ip_vs_ctl.c
@@ -3605,7 +3605,7 @@ int __net_init __ip_vs_control_init(struct net *net)
 
 	/* procfs stats */
 	ipvs->tot_stats.cpustats = alloc_percpu(struct ip_vs_cpu_stats);
-	if (ipvs->tot_stats.cpustats) {
+	if (!ipvs->tot_stats.cpustats) {
 		pr_err("%s(): alloc_percpu.\n", __func__);
 		return -ENOMEM;
 	}

Re: [slab poison overwritten] Re: [GIT] Networking

From: Simon Horman <horms@verge.net.au>
Date: 2011-03-21 22:14:11

On Mon, Mar 21, 2011 at 09:15:40PM +0100, Eric Dumazet wrote:
Le lundi 21 mars 2011 à 19:07 +0100, Eric Dumazet a écrit :
quoted
Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
quoted
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?
For the time being, we can avoid the false memory allocation error (and
leak)
Sorry, that typo is my work.
Thanks

[PATCH] ipvs: fix a typo in __ip_vs_control_init()

Reported-by: Ingo Molnar <redacted>
Signed-off-by: Eric Dumazet <redacted>
Cc: Simon Horman <horms@verge.net.au>
Cc: Julian Anastasov <ja@ssi.bg>
Acked-by: Simon Horman <horms@verge.net.au>
quoted hunk
---
 net/netfilter/ipvs/ip_vs_ctl.c |    2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/net/netfilter/ipvs/ip_vs_ctl.c b/net/netfilter/ipvs/ip_vs_ctl.c
index b799cea..33733c8 100644
--- a/net/netfilter/ipvs/ip_vs_ctl.c
+++ b/net/netfilter/ipvs/ip_vs_ctl.c
@@ -3605,7 +3605,7 @@ int __net_init __ip_vs_control_init(struct net *net)
 
 	/* procfs stats */
 	ipvs->tot_stats.cpustats = alloc_percpu(struct ip_vs_cpu_stats);
-	if (ipvs->tot_stats.cpustats) {
+	if (!ipvs->tot_stats.cpustats) {
 		pr_err("%s(): alloc_percpu.\n", __func__);
 		return -ENOMEM;
 	}

Re: [slab poison overwritten] Re: [GIT] Networking

From: Simon Horman <horms@verge.net.au>
Date: 2011-03-21 23:29:34

On Tue, Mar 22, 2011 at 07:13:58AM +0900, Simon Horman wrote:
On Mon, Mar 21, 2011 at 09:15:40PM +0100, Eric Dumazet wrote:
quoted
Le lundi 21 mars 2011 à 19:07 +0100, Eric Dumazet a écrit :
quoted
Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
quoted
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?
For the time being, we can avoid the false memory allocation error (and
leak)
Sorry, that typo is my work.
With your patch applied I now see the following

ffff880003bbf1a0 corresponds to &ipvs->app_key in __ip_vs_app_init().
I'll continue looking into this.

[   12.610000] IPVS: Creating netns size=2456 id=0
[   12.630000] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[   12.640000] BUG: key ffff880003bbf1a0 not in .data!
[   12.640000] ------------[ cut here ]------------
[   12.640000] WARNING: at kernel/lockdep.c:2701
lockdep_init_map+0x37b/0x570()
[   12.640000] Hardware name: Bochs
[   12.640000] Pid: 1, comm: swapper Tainted: G        W
2.6.38-kexec-06330-g69b7efe-dirty #122
[   12.650000] Call Trace:
[   12.650000]  [<ffffffff8102e685>] warn_slowpath_common+0x75/0xb0
[   12.650000]  [<ffffffff8102e6d5>] warn_slowpath_null+0x15/0x20
[   12.650000]  [<ffffffff8105967b>] lockdep_init_map+0x37b/0x570
[   12.650000]  [<ffffffff8105829d>] ? trace_hardirqs_on+0xd/0x10
[   12.650000]  [<ffffffff81055ad8>] debug_mutex_init+0x38/0x50
[   12.650000]  [<ffffffff8104bc4c>] __mutex_init+0x5c/0x70
[   12.650000]  [<ffffffff81685ee7>] __ip_vs_app_init+0x64/0x86
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1c33>] T.620+0x43/0x170
[   12.660000]  [<ffffffff811b1e9a>] ? register_pernet_subsys+0x1a/0x40
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1db7>] register_pernet_operations+0x57/0xb0
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.670000]  [<ffffffff811b1ea9>] register_pernet_subsys+0x29/0x40
[   12.670000]  [<ffffffff81685f19>] ip_vs_app_init+0x10/0x12
[   12.670000]  [<ffffffff81685a87>] ip_vs_init+0x4c/0xff
[   12.670000]  [<ffffffff8166562c>] do_one_initcall+0x7a/0x12e
[   12.670000]  [<ffffffff8166583e>] kernel_init+0x13e/0x1c2
[   12.670000]  [<ffffffff8128c134>] kernel_thread_helper+0x4/0x10
[   12.670000]  [<ffffffff8128ad40>] ? restore_args+0x0/0x30
[   12.680000]  [<ffffffff81665700>] ? kernel_init+0x0/0x1c2
[   12.680000]  [<ffffffff8128c130>] ? kernel_thread_helper+0x0/0x10
[   12.680000] ---[ end trace 4eaa2a86a8e2da23 ]---

Re: [slab poison overwritten] Re: [GIT] Networking

From: Simon Horman <horms@verge.net.au>
Date: 2011-03-22 00:01:44

On Tue, Mar 22, 2011 at 08:29:21AM +0900, Simon Horman wrote:
On Tue, Mar 22, 2011 at 07:13:58AM +0900, Simon Horman wrote:
quoted
On Mon, Mar 21, 2011 at 09:15:40PM +0100, Eric Dumazet wrote:
quoted
Le lundi 21 mars 2011 à 19:07 +0100, Eric Dumazet a écrit :
quoted
Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
quoted
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?
For the time being, we can avoid the false memory allocation error (and
leak)
Sorry, that typo is my work.
With your patch applied I now see the following

ffff880003bbf1a0 corresponds to &ipvs->app_key in __ip_vs_app_init().
I'll continue looking into this.

[   12.610000] IPVS: Creating netns size=2456 id=0
[   12.630000] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[   12.640000] BUG: key ffff880003bbf1a0 not in .data!
[   12.640000] ------------[ cut here ]------------
[   12.640000] WARNING: at kernel/lockdep.c:2701
lockdep_init_map+0x37b/0x570()
[   12.640000] Hardware name: Bochs
[   12.640000] Pid: 1, comm: swapper Tainted: G        W
2.6.38-kexec-06330-g69b7efe-dirty #122
[   12.650000] Call Trace:
[   12.650000]  [<ffffffff8102e685>] warn_slowpath_common+0x75/0xb0
[   12.650000]  [<ffffffff8102e6d5>] warn_slowpath_null+0x15/0x20
[   12.650000]  [<ffffffff8105967b>] lockdep_init_map+0x37b/0x570
[   12.650000]  [<ffffffff8105829d>] ? trace_hardirqs_on+0xd/0x10
[   12.650000]  [<ffffffff81055ad8>] debug_mutex_init+0x38/0x50
[   12.650000]  [<ffffffff8104bc4c>] __mutex_init+0x5c/0x70
[   12.650000]  [<ffffffff81685ee7>] __ip_vs_app_init+0x64/0x86
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1c33>] T.620+0x43/0x170
[   12.660000]  [<ffffffff811b1e9a>] ? register_pernet_subsys+0x1a/0x40
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1db7>] register_pernet_operations+0x57/0xb0
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.670000]  [<ffffffff811b1ea9>] register_pernet_subsys+0x29/0x40
[   12.670000]  [<ffffffff81685f19>] ip_vs_app_init+0x10/0x12
[   12.670000]  [<ffffffff81685a87>] ip_vs_init+0x4c/0xff
[   12.670000]  [<ffffffff8166562c>] do_one_initcall+0x7a/0x12e
[   12.670000]  [<ffffffff8166583e>] kernel_init+0x13e/0x1c2
[   12.670000]  [<ffffffff8128c134>] kernel_thread_helper+0x4/0x10
[   12.670000]  [<ffffffff8128ad40>] ? restore_args+0x0/0x30
[   12.680000]  [<ffffffff81665700>] ? kernel_init+0x0/0x1c2
[   12.680000]  [<ffffffff8128c130>] ? kernel_thread_helper+0x0/0x10
[   12.680000] ---[ end trace 4eaa2a86a8e2da23 ]---
It seems that the problem above was introduced by
ab8a5e8408c3 ("IPVS: netns awareness to ip_vs_app").
I assume the hungs are the cause:
diff --git a/net/netfilter/ipvs/ip_vs_app.c b/net/netfilter/ipvs/ip_vs_app.c
index 40b09cc..286f465 100644
--- a/net/netfilter/ipvs/ip_vs_app.c
+++ b/net/netfilter/ipvs/ip_vs_app.c
@@ -43,11 +43,6 @@ EXPORT_SYMBOL(register_ip_vs_app);
 EXPORT_SYMBOL(unregister_ip_vs_app);
 EXPORT_SYMBOL(register_ip_vs_app_inc);
 
-/* ipvs application list head */
-static LIST_HEAD(ip_vs_app_list);
-static DEFINE_MUTEX(__ip_vs_app_mutex);
-
-
 /*
  *	Get an ip_vs_app object
  */
@@ -571,9 +580,13 @@ static const struct file_operations ip_vs_app_fops = {
 
 static int __net_init __ip_vs_app_init(struct net *net)
 {
+	struct netns_ipvs *ipvs = net_ipvs(net);
+
 	if (!net_eq(net, &init_net))	/* netns not enabled yet */
 		return -EPERM;
 
+	INIT_LIST_HEAD(&ipvs->app_list);
+	__mutex_init(&ipvs->app_mutex, "ipvs->app_mutex", &ipvs->app_key);
 	proc_net_fops_create(net, "ip_vs_app", 0, &ip_vs_app_fops);
 	return 0;
 }


Re: [slab poison overwritten] Re: [GIT] Networking

From: Simon Horman <horms@verge.net.au>
Date: 2011-03-22 00:17:14

On Tue, Mar 22, 2011 at 09:01:33AM +0900, Simon Horman wrote:
On Tue, Mar 22, 2011 at 08:29:21AM +0900, Simon Horman wrote:
quoted
On Tue, Mar 22, 2011 at 07:13:58AM +0900, Simon Horman wrote:
quoted
On Mon, Mar 21, 2011 at 09:15:40PM +0100, Eric Dumazet wrote:
quoted
Le lundi 21 mars 2011 à 19:07 +0100, Eric Dumazet a écrit :
quoted
Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
quoted
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?
For the time being, we can avoid the false memory allocation error (and
leak)
Sorry, that typo is my work.
With your patch applied I now see the following

ffff880003bbf1a0 corresponds to &ipvs->app_key in __ip_vs_app_init().
I'll continue looking into this.

[   12.610000] IPVS: Creating netns size=2456 id=0
[   12.630000] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[   12.640000] BUG: key ffff880003bbf1a0 not in .data!
[   12.640000] ------------[ cut here ]------------
[   12.640000] WARNING: at kernel/lockdep.c:2701
lockdep_init_map+0x37b/0x570()
[   12.640000] Hardware name: Bochs
[   12.640000] Pid: 1, comm: swapper Tainted: G        W
2.6.38-kexec-06330-g69b7efe-dirty #122
[   12.650000] Call Trace:
[   12.650000]  [<ffffffff8102e685>] warn_slowpath_common+0x75/0xb0
[   12.650000]  [<ffffffff8102e6d5>] warn_slowpath_null+0x15/0x20
[   12.650000]  [<ffffffff8105967b>] lockdep_init_map+0x37b/0x570
[   12.650000]  [<ffffffff8105829d>] ? trace_hardirqs_on+0xd/0x10
[   12.650000]  [<ffffffff81055ad8>] debug_mutex_init+0x38/0x50
[   12.650000]  [<ffffffff8104bc4c>] __mutex_init+0x5c/0x70
[   12.650000]  [<ffffffff81685ee7>] __ip_vs_app_init+0x64/0x86
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1c33>] T.620+0x43/0x170
[   12.660000]  [<ffffffff811b1e9a>] ? register_pernet_subsys+0x1a/0x40
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1db7>] register_pernet_operations+0x57/0xb0
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.670000]  [<ffffffff811b1ea9>] register_pernet_subsys+0x29/0x40
[   12.670000]  [<ffffffff81685f19>] ip_vs_app_init+0x10/0x12
[   12.670000]  [<ffffffff81685a87>] ip_vs_init+0x4c/0xff
[   12.670000]  [<ffffffff8166562c>] do_one_initcall+0x7a/0x12e
[   12.670000]  [<ffffffff8166583e>] kernel_init+0x13e/0x1c2
[   12.670000]  [<ffffffff8128c134>] kernel_thread_helper+0x4/0x10
[   12.670000]  [<ffffffff8128ad40>] ? restore_args+0x0/0x30
[   12.680000]  [<ffffffff81665700>] ? kernel_init+0x0/0x1c2
[   12.680000]  [<ffffffff8128c130>] ? kernel_thread_helper+0x0/0x10
[   12.680000] ---[ end trace 4eaa2a86a8e2da23 ]---
It seems that the problem above was introduced by
ab8a5e8408c3 ("IPVS: netns awareness to ip_vs_app").
I assume the hungs are the cause:
s/hungs/hunks below/

I am a little unsure of what to do about this.

The problem seems to be that ipvs->app_key is not in static storage.
But I'm not sure how to resolve that given that the struct netns_ipvs is
per-network namespace. So I guess that the locking needs to be re-worked.
Again, I'm a little unsure of what the best way forward is.
quoted hunk
diff --git a/net/netfilter/ipvs/ip_vs_app.c b/net/netfilter/ipvs/ip_vs_app.c
index 40b09cc..286f465 100644
--- a/net/netfilter/ipvs/ip_vs_app.c
+++ b/net/netfilter/ipvs/ip_vs_app.c
@@ -43,11 +43,6 @@ EXPORT_SYMBOL(register_ip_vs_app);
 EXPORT_SYMBOL(unregister_ip_vs_app);
 EXPORT_SYMBOL(register_ip_vs_app_inc);
 
-/* ipvs application list head */
-static LIST_HEAD(ip_vs_app_list);
-static DEFINE_MUTEX(__ip_vs_app_mutex);
-
-
 /*
  *	Get an ip_vs_app object
  */
@@ -571,9 +580,13 @@ static const struct file_operations ip_vs_app_fops = {
 
 static int __net_init __ip_vs_app_init(struct net *net)
 {
+	struct netns_ipvs *ipvs = net_ipvs(net);
+
 	if (!net_eq(net, &init_net))	/* netns not enabled yet */
 		return -EPERM;
 
+	INIT_LIST_HEAD(&ipvs->app_list);
+	__mutex_init(&ipvs->app_mutex, "ipvs->app_mutex", &ipvs->app_key);
 	proc_net_fops_create(net, "ip_vs_app", 0, &ip_vs_app_fops);
 	return 0;
 }

Re: [held lock freed] Re: [GIT] Networking

From: David Miller <davem@davemloft.net>
Date: 2011-03-22 01:15:54

From: Ingo Molnar <redacted>
Date: Mon, 21 Mar 2011 17:15:28 +0100
* Eric Dumazet [off-list ref] wrote:
quoted
Here is a probable fix.

[PATCH] ipx: fix ipx_release()
This patch did the trick - thanks Eric!

Tested-by: Ingo Molnar <redacted>
Applied, thanks everyone.

Re: [held lock freed] Re: [GIT] Networking

From: David Miller <davem@davemloft.net>
Date: 2011-03-22 01:17:41

From: Arnd Bergmann <arnd@arndb.de>
Date: Mon, 21 Mar 2011 16:22:40 +0100
net/appletalk: fix atalk_release use after free

The BKL removal in appletalk introduced a use-after-free problem,
where atalk_destroy_socket frees a sock, but we still release
the socket lock on it.

An easy fix is to take an extra reference on the sock and sock_put
it when returning from atalk_release.

Signed-off-by: Arnd Bergmann <arnd@arndb.de>
Applied, thanks Arnd.

Re: [slab poison overwritten] Re: [GIT] Networking

From: Simon Horman <horms@verge.net.au>
Date: 2011-03-22 01:18:10

On Tue, Mar 22, 2011 at 09:17:07AM +0900, Simon Horman wrote:
On Tue, Mar 22, 2011 at 09:01:33AM +0900, Simon Horman wrote:
quoted
On Tue, Mar 22, 2011 at 08:29:21AM +0900, Simon Horman wrote:
quoted
On Tue, Mar 22, 2011 at 07:13:58AM +0900, Simon Horman wrote:
quoted
On Mon, Mar 21, 2011 at 09:15:40PM +0100, Eric Dumazet wrote:
quoted
Le lundi 21 mars 2011 à 19:07 +0100, Eric Dumazet a écrit :
quoted
Le lundi 21 mars 2011 à 18:39 +0100, Ingo Molnar a écrit :
quoted
here's the same but with kallsyms enabled.

Thanks,

	Ingo

[    9.585627] initcall 0xffffffff81d5b806 returned 0 after 0 usecs
[    9.588960] calling  0xffffffff81d5b9da @ 1
[    9.592303] IPVS: Creating netns size=1272 id=0
[    9.595646] IPVS: __ip_vs_control_init(): alloc_percpu.
[    9.602298] IPVS: cannot register namespace.
[    9.605627] IPVS: can't setup control
It seems IPVS is busted in case of memory allocation error in 
__ip_vs_control_init()

IPVS deinits its "struct netns_ipvs" space, but something (in IPVS) uses
it after free.

__ip_vs_init() seems to be called before ip_vs_init() completes
correctly. We then keep in net->ipvs a pointer to some freed memory.

Commit 14e405461e664b7 did some changes in this area

Simon, any idea ?
For the time being, we can avoid the false memory allocation error (and
leak)
Sorry, that typo is my work.
With your patch applied I now see the following

ffff880003bbf1a0 corresponds to &ipvs->app_key in __ip_vs_app_init().
I'll continue looking into this.

[   12.610000] IPVS: Creating netns size=2456 id=0
[   12.630000] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[   12.640000] BUG: key ffff880003bbf1a0 not in .data!
[   12.640000] ------------[ cut here ]------------
[   12.640000] WARNING: at kernel/lockdep.c:2701
lockdep_init_map+0x37b/0x570()
[   12.640000] Hardware name: Bochs
[   12.640000] Pid: 1, comm: swapper Tainted: G        W
2.6.38-kexec-06330-g69b7efe-dirty #122
[   12.650000] Call Trace:
[   12.650000]  [<ffffffff8102e685>] warn_slowpath_common+0x75/0xb0
[   12.650000]  [<ffffffff8102e6d5>] warn_slowpath_null+0x15/0x20
[   12.650000]  [<ffffffff8105967b>] lockdep_init_map+0x37b/0x570
[   12.650000]  [<ffffffff8105829d>] ? trace_hardirqs_on+0xd/0x10
[   12.650000]  [<ffffffff81055ad8>] debug_mutex_init+0x38/0x50
[   12.650000]  [<ffffffff8104bc4c>] __mutex_init+0x5c/0x70
[   12.650000]  [<ffffffff81685ee7>] __ip_vs_app_init+0x64/0x86
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1c33>] T.620+0x43/0x170
[   12.660000]  [<ffffffff811b1e9a>] ? register_pernet_subsys+0x1a/0x40
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1db7>] register_pernet_operations+0x57/0xb0
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.670000]  [<ffffffff811b1ea9>] register_pernet_subsys+0x29/0x40
[   12.670000]  [<ffffffff81685f19>] ip_vs_app_init+0x10/0x12
[   12.670000]  [<ffffffff81685a87>] ip_vs_init+0x4c/0xff
[   12.670000]  [<ffffffff8166562c>] do_one_initcall+0x7a/0x12e
[   12.670000]  [<ffffffff8166583e>] kernel_init+0x13e/0x1c2
[   12.670000]  [<ffffffff8128c134>] kernel_thread_helper+0x4/0x10
[   12.670000]  [<ffffffff8128ad40>] ? restore_args+0x0/0x30
[   12.680000]  [<ffffffff81665700>] ? kernel_init+0x0/0x1c2
[   12.680000]  [<ffffffff8128c130>] ? kernel_thread_helper+0x0/0x10
[   12.680000] ---[ end trace 4eaa2a86a8e2da23 ]---
It seems that the problem above was introduced by
ab8a5e8408c3 ("IPVS: netns awareness to ip_vs_app").
I assume the hungs are the cause:
s/hungs/hunks below/

I am a little unsure of what to do about this.

The problem seems to be that ipvs->app_key is not in static storage.
But I'm not sure how to resolve that given that the struct netns_ipvs is
per-network namespace. So I guess that the locking needs to be re-worked.
Again, I'm a little unsure of what the best way forward is.
I had an idea for a fix over breakfast.

IPVS: Use global mutex in ip_vs_app.c

As part of the work to make IPVS network namespace aware
__ip_vs_app_mutex was replaced by a per-namespace lock,
ipvs->app_mutex. ipvs->app_key is also supplied for debugging purposes.

Unfortunately this implementation results in ipvs->app_key residing
in non-static storage which at the very least causes a lockdep warning.

This patch takes the rather heavy-handed approach of reinstating
__ip_vs_app_mutex which will cover access to the ipvs->list_head
of all network namespaces.

[   12.610000] IPVS: Creating netns size=2456 id=0
[   12.630000] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[   12.640000] BUG: key ffff880003bbf1a0 not in .data!
[   12.640000] ------------[ cut here ]------------
[   12.640000] WARNING: at kernel/lockdep.c:2701 lockdep_init_map+0x37b/0x570()
[   12.640000] Hardware name: Bochs
[   12.640000] Pid: 1, comm: swapper Tainted: G        W 2.6.38-kexec-06330-g69b7efe-dirty #122
[   12.650000] Call Trace:
[   12.650000]  [<ffffffff8102e685>] warn_slowpath_common+0x75/0xb0
[   12.650000]  [<ffffffff8102e6d5>] warn_slowpath_null+0x15/0x20
[   12.650000]  [<ffffffff8105967b>] lockdep_init_map+0x37b/0x570
[   12.650000]  [<ffffffff8105829d>] ? trace_hardirqs_on+0xd/0x10
[   12.650000]  [<ffffffff81055ad8>] debug_mutex_init+0x38/0x50
[   12.650000]  [<ffffffff8104bc4c>] __mutex_init+0x5c/0x70
[   12.650000]  [<ffffffff81685ee7>] __ip_vs_app_init+0x64/0x86
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1c33>] T.620+0x43/0x170
[   12.660000]  [<ffffffff811b1e9a>] ? register_pernet_subsys+0x1a/0x40
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.660000]  [<ffffffff811b1db7>] register_pernet_operations+0x57/0xb0
[   12.660000]  [<ffffffff81685a3b>] ? ip_vs_init+0x0/0xff
[   12.670000]  [<ffffffff811b1ea9>] register_pernet_subsys+0x29/0x40
[   12.670000]  [<ffffffff81685f19>] ip_vs_app_init+0x10/0x12
[   12.670000]  [<ffffffff81685a87>] ip_vs_init+0x4c/0xff
[   12.670000]  [<ffffffff8166562c>] do_one_initcall+0x7a/0x12e
[   12.670000]  [<ffffffff8166583e>] kernel_init+0x13e/0x1c2
[   12.670000]  [<ffffffff8128c134>] kernel_thread_helper+0x4/0x10
[   12.670000]  [<ffffffff8128ad40>] ? restore_args+0x0/0x30
[   12.680000]  [<ffffffff81665700>] ? kernel_init+0x0/0x1c2
[   12.680000]  [<ffffffff8128c130>] ? kernel_thread_helper+0x0/0x1global0

Signed-off-by: Simon Horman <horms@verge.net.au>
Cc: Ingo Molnar <redacted>
Cc: Eric Dumazet <redacted>
Cc: Julian Anastasov <ja@ssi.bg>
Cc: Hans Schillstrom <redacted>
---
 include/net/ip_vs.h            |    2 --
 net/netfilter/ipvs/ip_vs_app.c |   23 ++++++++++-------------
 2 files changed, 10 insertions(+), 15 deletions(-)
diff --git a/include/net/ip_vs.h b/include/net/ip_vs.h
index 272f593..30b49ed 100644
--- a/include/net/ip_vs.h
+++ b/include/net/ip_vs.h
@@ -801,8 +801,6 @@ struct netns_ipvs {
 	struct list_head	rs_table[IP_VS_RTAB_SIZE];
 	/* ip_vs_app */
 	struct list_head	app_list;
-	struct mutex		app_mutex;
-	struct lock_class_key	app_key;	/* mutex debuging */
 
 	/* ip_vs_proto */
 	#define IP_VS_PROTO_TAB_SIZE	32	/* must be power of 2 */
diff --git a/net/netfilter/ipvs/ip_vs_app.c b/net/netfilter/ipvs/ip_vs_app.c
index 5c48ffb..2dc6de1 100644
--- a/net/netfilter/ipvs/ip_vs_app.c
+++ b/net/netfilter/ipvs/ip_vs_app.c
@@ -43,6 +43,8 @@ EXPORT_SYMBOL(register_ip_vs_app);
 EXPORT_SYMBOL(unregister_ip_vs_app);
 EXPORT_SYMBOL(register_ip_vs_app_inc);
 
+static DEFINE_MUTEX(__ip_vs_app_mutex);
+
 /*
  *	Get an ip_vs_app object
  */
@@ -167,14 +169,13 @@ int
 register_ip_vs_app_inc(struct net *net, struct ip_vs_app *app, __u16 proto,
 		       __u16 port)
 {
-	struct netns_ipvs *ipvs = net_ipvs(net);
 	int result;
 
-	mutex_lock(&ipvs->app_mutex);
+	mutex_lock(&__ip_vs_app_mutex);
 
 	result = ip_vs_app_inc_new(net, app, proto, port);
 
-	mutex_unlock(&ipvs->app_mutex);
+	mutex_unlock(&__ip_vs_app_mutex);
 
 	return result;
 }
@@ -189,11 +190,11 @@ int register_ip_vs_app(struct net *net, struct ip_vs_app *app)
 	/* increase the module use count */
 	ip_vs_use_count_inc();
 
-	mutex_lock(&ipvs->app_mutex);
+	mutex_lock(&__ip_vs_app_mutex);
 
 	list_add(&app->a_list, &ipvs->app_list);
 
-	mutex_unlock(&ipvs->app_mutex);
+	mutex_unlock(&__ip_vs_app_mutex);
 
 	return 0;
 }
@@ -205,10 +206,9 @@ int register_ip_vs_app(struct net *net, struct ip_vs_app *app)
  */
 void unregister_ip_vs_app(struct net *net, struct ip_vs_app *app)
 {
-	struct netns_ipvs *ipvs = net_ipvs(net);
 	struct ip_vs_app *inc, *nxt;
 
-	mutex_lock(&ipvs->app_mutex);
+	mutex_lock(&__ip_vs_app_mutex);
 
 	list_for_each_entry_safe(inc, nxt, &app->incs_list, a_list) {
 		ip_vs_app_inc_release(net, inc);
@@ -216,7 +216,7 @@ void unregister_ip_vs_app(struct net *net, struct ip_vs_app *app)
 
 	list_del(&app->a_list);
 
-	mutex_unlock(&ipvs->app_mutex);
+	mutex_unlock(&__ip_vs_app_mutex);
 
 	/* decrease the module use count */
 	ip_vs_use_count_dec();
@@ -501,7 +501,7 @@ static void *ip_vs_app_seq_start(struct seq_file *seq, loff_t *pos)
 	struct net *net = seq_file_net(seq);
 	struct netns_ipvs *ipvs = net_ipvs(net);
 
-	mutex_lock(&ipvs->app_mutex);
+	mutex_lock(&__ip_vs_app_mutex);
 
 	return *pos ? ip_vs_app_idx(ipvs, *pos - 1) : SEQ_START_TOKEN;
 }
@@ -535,9 +535,7 @@ static void *ip_vs_app_seq_next(struct seq_file *seq, void *v, loff_t *pos)
 
 static void ip_vs_app_seq_stop(struct seq_file *seq, void *v)
 {
-	struct netns_ipvs *ipvs = net_ipvs(seq_file_net(seq));
-
-	mutex_unlock(&ipvs->app_mutex);
+	mutex_unlock(&__ip_vs_app_mutex);
 }
 
 static int ip_vs_app_seq_show(struct seq_file *seq, void *v)
@@ -583,7 +581,6 @@ static int __net_init __ip_vs_app_init(struct net *net)
 	struct netns_ipvs *ipvs = net_ipvs(net);
 
 	INIT_LIST_HEAD(&ipvs->app_list);
-	__mutex_init(&ipvs->app_mutex, "ipvs->app_mutex", &ipvs->app_key);
 	proc_net_fops_create(net, "ip_vs_app", 0, &ip_vs_app_fops);
 	return 0;
 }
-- 
1.7.2.3

Re: [slab poison overwritten] Re: [GIT] Networking

From: David Miller <davem@davemloft.net>
Date: 2011-03-22 03:39:06

From: Simon Horman <horms@verge.net.au>
Date: Tue, 22 Mar 2011 07:13:58 +0900
On Mon, Mar 21, 2011 at 09:15:40PM +0100, Eric Dumazet wrote:
quoted
[PATCH] ipvs: fix a typo in __ip_vs_control_init()

Reported-by: Ingo Molnar <redacted>
Signed-off-by: Eric Dumazet <redacted>
Cc: Simon Horman <horms@verge.net.au>
Cc: Julian Anastasov <ja@ssi.bg>
Acked-by: Simon Horman <horms@verge.net.au>
Applied.

Re: [slab poison overwritten] Re: [GIT] Networking

From: David Miller <davem@davemloft.net>
Date: 2011-03-22 03:39:41

From: Simon Horman <horms@verge.net.au>
Date: Tue, 22 Mar 2011 10:18:01 +0900
IPVS: Use global mutex in ip_vs_app.c

As part of the work to make IPVS network namespace aware
__ip_vs_app_mutex was replaced by a per-namespace lock,
ipvs->app_mutex. ipvs->app_key is also supplied for debugging purposes.

Unfortunately this implementation results in ipvs->app_key residing
in non-static storage which at the very least causes a lockdep warning.

This patch takes the rather heavy-handed approach of reinstating
__ip_vs_app_mutex which will cover access to the ipvs->list_head
of all network namespaces.
 ...
Signed-off-by: Simon Horman <horms@verge.net.au>
Applied, thanks Simon.

Re: [GIT] Networking

From: David Miller <davem@davemloft.net>
Date: 2011-03-22 04:09:01

From: Linus Torvalds <torvalds@linux-foundation.org>
Date: Mon, 21 Mar 2011 12:24:12 -0700
That said, I'm delaying this pull request due to the known issues with
it - let me know when you've updated it with the fix for the
use-after-free fixes and the slab corruptor (the latter of which I
haven't seen a patch for yet)
I've intergrated several bug fixes, including those for all of the
problems Ingo reported:

1) Non-netlink ipsec configurations fail to initialize
   replay info, resulting in OOPS.  Fix from Wei Yongjun.

2) L2TP marks l2tp_eth_net_ops as __net_initdata causing OOPS
   on module unload, fix from James Chapman.

3) lock_kernel removal regression fixes from Eric Dumazet and
   Arnd Bergmann.  Both IPX and Appletalk could release a socket
   while holding that socket's lock.

4) C_CAN driver enables interrupts before chip is actually ready,
   fix from Jan Altenberg.

5) Use after free in macvlan, fix from Eric W. Biederman.

6) ipv6 creates dup "neigh" sysfs directories, also from Eric
   W. Biederman.

7) VETH over-increments TX/RX byte counters, also from Eric
   W. Biederman.

8) Two IPVS bug fixes:
   a) Reverse NULL check after allocation, from Eric Dumazet.
   b) mutex lockdep key invalidly in dynamic memory, fix from
      Simon Horman.

Please pull, thanks a lot:

The following changes since commit a44f99c7efdb88fa41128065c9a9445c19894e34:

  Merge branch 'trivial' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6 (2011-03-20 18:14:55 -0700)

are available in the git repository at:

  master.kernel.org:/pub/scm/linux/kernel/git/davem/net-2.6.git master

Alex Dubov (1):
      gianfar: Fall back to software tcp/udp checksum on older controllers

Arnd Bergmann (1):
      net/appletalk: fix atalk_release use after free

Ben Hutchings (1):
      ethtool: Compat handling for struct ethtool_rxnfc

Dan Carpenter (1):
      ftmac100: use resource_size()

David S. Miller (3):
      niu: Rename NIU parent platform device name to fix conflict.
      Merge branch 'master' of git://git.kernel.org/.../kaber/nf-2.6
      Merge branch 'vhost-net-next' of git://git.kernel.org/.../mst/vhost

Eric Dumazet (6):
      vlan: should take into account needed_headroom
      r8169: fix a bug in rtl8169_init_phy()
      netfilter: xtables: fix reentrancy
      snmp: SNMP_UPD_PO_STATS_BH() always called from softirq
      ipx: fix ipx_release()
      ipvs: fix a typo in __ip_vs_control_init()

Eric W. Biederman (3):
      macvlan: Fix use after free of struct macvlan_port.
      net ipv6: Fix duplicate /proc/sys/net/ipv6/neigh directory entries.
      veth: Fix the byte counters

Herbert Xu (1):
      bridge: Reset IPCB when entering IP stack on NF_FORWARD

James Chapman (1):
      l2tp: fix possible oops on l2tp_eth module unload

Jan Altenberg (1):
      can: c_can: Do basic c_can configuration _before_ enabling the interrupts

Jason Wang (3):
      vhost-net: check the support of mergeable buffer outside the receive loop
      vhost-net: Unify the code of mergeable and big buffer handling
      vhost: lock receive queue, not the socket

Jozsef Kadlecsik (2):
      netfilter: ipset: fix address ranges at hash:*port* types
      netfilter: ipset: fix checking the type revision at create command

Krishna Kumar (1):
      vhost: Cleanup vhost.c and net.c

Michael S. Tsirkin (2):
      vhost: copy_from_user -> __copy_from_user
      vhost-net: remove unlocked use of receive_queue

Mike Frysinger (1):
      headers: use __aligned_xx types for userspace

Neil Horman (1):
      net: fix incorrect spelling in drop monitor protocol

Nicolas de Pesloüan (1):
      bonding: fix a typo in a comment

Roger Luethi (1):
      ethtool: __ethtool_set_sg: check for function pointer before using it

Simon Horman (1):
      IPVS: Use global mutex in ip_vs_app.c

Vasiliy Kulikov (2):
      econet: 4 byte infoleak to the network
      netfilter: ipt_CLUSTERIP: fix buffer overflow

Wei Yongjun (1):
      xfrm: Fix initialize repl field of struct xfrm_state

 drivers/net/bonding/bond_main.c                |    2 +-
 drivers/net/can/c_can/c_can.c                  |    6 +-
 drivers/net/ftmac100.c                         |    2 +-
 drivers/net/gianfar.c                          |   16 ++-
 drivers/net/gianfar.h                          |    1 +
 drivers/net/macvlan.c                          |   18 ++-
 drivers/net/niu.c                              |    2 +-
 drivers/net/r8169.c                            |    4 +-
 drivers/net/veth.c                             |    2 +-
 drivers/vhost/net.c                            |  159 ++++--------------------
 drivers/vhost/vhost.c                          |   55 ++++++---
 include/linux/ethtool.h                        |   34 +++++
 include/linux/if_ppp.h                         |   16 ++--
 include/linux/netfilter/ipset/ip_set_getport.h |   10 ++
 include/linux/netfilter/nfnetlink_log.h        |    4 +-
 include/linux/netfilter/nfnetlink_queue.h      |    4 +-
 include/linux/netfilter/xt_connbytes.h         |    4 +-
 include/linux/netfilter/xt_quota.h             |    2 +-
 include/net/ip_vs.h                            |    2 -
 include/net/snmp.h                             |    4 +-
 include/net/xfrm.h                             |    1 +
 net/8021q/vlan_dev.c                           |    1 +
 net/appletalk/ddp.c                            |    3 +
 net/bridge/br_netfilter.c                      |    3 +
 net/core/drop_monitor.c                        |    2 +-
 net/core/ethtool.c                             |    3 +
 net/econet/af_econet.c                         |    2 +-
 net/ipv4/netfilter/ip_tables.c                 |    4 +-
 net/ipv4/netfilter/ipt_CLUSTERIP.c             |    5 +-
 net/ipv6/netfilter/ip6_tables.c                |    4 +-
 net/ipv6/sysctl_net_ipv6.c                     |   18 ++-
 net/ipx/af_ipx.c                               |    2 +-
 net/l2tp/l2tp_eth.c                            |    2 +-
 net/netfilter/ipset/ip_set_core.c              |   22 +++-
 net/netfilter/ipset/ip_set_hash_ipport.c       |   34 ++----
 net/netfilter/ipset/ip_set_hash_ipportip.c     |   34 ++----
 net/netfilter/ipset/ip_set_hash_ipportnet.c    |   34 ++----
 net/netfilter/ipset/ip_set_hash_netport.c      |   30 ++----
 net/netfilter/ipvs/ip_vs_app.c                 |   23 ++--
 net/netfilter/ipvs/ip_vs_ctl.c                 |    2 +-
 net/socket.c                                   |  114 ++++++++++++++++-
 net/xfrm/xfrm_state.c                          |   15 ++-
 net/xfrm/xfrm_user.c                           |    2 +-
 43 files changed, 383 insertions(+), 324 deletions(-)

Re: [slab poison overwritten] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-22 09:07:59

* Ingo Molnar [off-list ref] wrote:
here's the same but with kallsyms enabled.
Sorry, wrong log - find below a kallsyms enabled one.

I'll test the patches in this thread.

Thanks,

	Ingo

--------------->
calling  dell_init+0x0/0xa @ 1
initcall dell_init+0x0/0xa returned -19 after 2 usecs
calling  dell_wmi_init+0x0/0xd4 @ 1
dell-wmi: No known WMI GUID found
initcall dell_wmi_init+0x0/0xd4 returned -19 after 2 usecs
calling  tc1100_init+0x0/0x78 @ 1
initcall tc1100_init+0x0/0x78 returned -19 after 2 usecs
calling  hdaps_init+0x0/0x2d @ 1
hdaps: supported laptop not found!
hdaps: driver init failed (ret=-19)!
initcall hdaps_init+0x0/0x2d returned -19 after 2 usecs
calling  fujitsu_init+0x0/0x21d @ 1
fujitsu-laptop: driver 0.6.0 successfully loaded.
initcall fujitsu_init+0x0/0x21d returned 0 after 393 usecs
calling  acpi_pcc_init+0x0/0x23 @ 1
initcall acpi_pcc_init+0x0/0x23 returned 0 after 59 usecs
calling  intel_menlow_module_init+0x0/0x8f @ 1
initcall intel_menlow_module_init+0x0/0x8f returned -19 after 13 usecs
calling  msi_wmi_init+0x0/0x15b @ 1
This machine doesn't have MSI-hotkeys through WMI
initcall msi_wmi_init+0x0/0x15b returned -19 after 3 usecs
calling  asus_acpi_init+0x0/0xdf @ 1
initcall asus_acpi_init+0x0/0xdf returned -19 after 98 usecs
calling  topstar_laptop_init+0x0/0x22 @ 1
Topstar Laptop ACPI extras driver loaded
initcall topstar_laptop_init+0x0/0x22 returned 0 after 50 usecs
calling  ibm_rtl_init+0x0/0x245 @ 1
initcall ibm_rtl_init+0x0/0x245 returned -19 after 2 usecs
calling  flow_cache_init_global+0x0/0x112 @ 1
initcall flow_cache_init_global+0x0/0x112 returned 0 after 179 usecs
calling  pg_init+0x0/0x2b0 @ 1
pktgen: Packet Generator for packet performance testing. Version: 2.74
usb usb2: rpm_suspend returns 0
usb usb1: rpm_suspend flags 0x9
usb usb1: rpm_suspend returns 0
initcall pg_init+0x0/0x2b0 returned 0 after 1543240 usecs
calling  llc_init+0x0/0x1b @ 1
initcall llc_init+0x0/0x1b returned 0 after 2 usecs
calling  snap_init+0x0/0x33 @ 1
initcall snap_init+0x0/0x33 returned 0 after 6 usecs
calling  blackhole_module_init+0x0/0xf @ 1
initcall blackhole_module_init+0x0/0xf returned 0 after 2 usecs
calling  police_init_module+0x0/0xf @ 1
initcall police_init_module+0x0/0xf returned 0 after 2 usecs
calling  ipt_init_module+0x0/0xf @ 1
initcall ipt_init_module+0x0/0xf returned 0 after 1 usecs
calling  skbedit_init_module+0x0/0xf @ 1
initcall skbedit_init_module+0x0/0xf returned 0 after 1 usecs
calling  red_module_init+0x0/0xf @ 1
initcall red_module_init+0x0/0xf returned 0 after 1 usecs
calling  gred_module_init+0x0/0xf @ 1
initcall gred_module_init+0x0/0xf returned 0 after 1 usecs
calling  ingress_module_init+0x0/0xf @ 1
initcall ingress_module_init+0x0/0xf returned 0 after 1 usecs
calling  dsmark_module_init+0x0/0xf @ 1
initcall dsmark_module_init+0x0/0xf returned 0 after 2 usecs
calling  sfb_module_init+0x0/0xf @ 1
initcall sfb_module_init+0x0/0xf returned 0 after 1 usecs
calling  sfq_module_init+0x0/0xf @ 1
initcall sfq_module_init+0x0/0xf returned 0 after 1 usecs
calling  prio_module_init+0x0/0xf @ 1
initcall prio_module_init+0x0/0xf returned 0 after 1 usecs
calling  multiq_module_init+0x0/0xf @ 1
initcall multiq_module_init+0x0/0xf returned 0 after 1 usecs
calling  atm_init+0x0/0xf @ 1
initcall atm_init+0x0/0xf returned 0 after 1 usecs
calling  netem_module_init+0x0/0x1c @ 1
netem: version 1.3
initcall netem_module_init+0x0/0x1c returned 0 after 1710 usecs
calling  mqprio_module_init+0x0/0xf @ 1
initcall mqprio_module_init+0x0/0xf returned 0 after 1 usecs
calling  choke_module_init+0x0/0xf @ 1
initcall choke_module_init+0x0/0xf returned 0 after 1 usecs
calling  init_fw+0x0/0xf @ 1
initcall init_fw+0x0/0xf returned 0 after 1 usecs
calling  init_rsvp+0x0/0xf @ 1
initcall init_rsvp+0x0/0xf returned 0 after 1 usecs
calling  init_basic+0x0/0xf @ 1
initcall init_basic+0x0/0xf returned 0 after 1 usecs
calling  cls_flow_init+0x0/0xf @ 1
initcall cls_flow_init+0x0/0xf returned 0 after 1 usecs
calling  init_em_cmp+0x0/0xf @ 1
initcall init_em_cmp+0x0/0xf returned 0 after 1 usecs
calling  init_em_meta+0x0/0xf @ 1
initcall init_em_meta+0x0/0xf returned 0 after 1 usecs
calling  nfnetlink_init+0x0/0x26 @ 1
Netfilter messages via NETLINK v0.30.
initcall nfnetlink_init+0x0/0x26 returned 0 after 3335 usecs
calling  nfnetlink_log_init+0x0/0xbe @ 1
initcall nfnetlink_log_init+0x0/0xbe returned 0 after 12 usecs
calling  nf_conntrack_standalone_init+0x0/0xf @ 1
nf_conntrack version 0.5.0 (16004 buckets, 64016 max)
initcall nf_conntrack_standalone_init+0x0/0xf returned 0 after 5043 usecs
calling  nf_conntrack_ftp_init+0x0/0x1ae @ 1
initcall nf_conntrack_ftp_init+0x0/0x1ae returned 0 after 3 usecs
calling  nf_conntrack_irc_init+0x0/0x15e @ 1
initcall nf_conntrack_irc_init+0x0/0x15e returned 0 after 2 usecs
calling  xt_init+0x0/0xc6 @ 1
initcall xt_init+0x0/0xc6 returned 0 after 4 usecs
calling  tcpudp_mt_init+0x0/0x14 @ 1
initcall tcpudp_mt_init+0x0/0x14 returned 0 after 2 usecs
calling  ip_vs_init+0x0/0xe9 @ 1
IPVS: Creating netns size=904 id=0
IPVS: __ip_vs_control_init(): alloc_percpu.
usb usb1: rpm_suspend flags 0xa
usb usb1: rpm_suspend returns 0
IPVS: cannot register namespace.
IPVS: can't setup control.
initcall ip_vs_init+0x0/0xe9 returned -12 after 27614 usecs
initcall ip_vs_init+0x0/0xe9 returned with error code -12 
calling  ip_vs_rr_init+0x0/0xf @ 1
IPVS: [rr] scheduler registered.
initcall ip_vs_rr_init+0x0/0xf returned 0 after 2902 usecs
calling  ip_vs_wlc_init+0x0/0xf @ 1
IPVS: [wlc] scheduler registered.
initcall ip_vs_wlc_init+0x0/0xf returned 0 after 2978 usecs
calling  ip_vs_lblc_init+0x0/0x33 @ 1
IPVS: [lblc] scheduler registered.
initcall ip_vs_lblc_init+0x0/0x33 returned 0 after 3080 usecs
calling  ip_vs_sed_init+0x0/0xf @ 1
IPVS: [sed] scheduler registered.
initcall ip_vs_sed_init+0x0/0xf returned 0 after 2987 usecs
calling  ip_vs_nq_init+0x0/0xf @ 1
IPVS: [nq] scheduler registered.
initcall ip_vs_nq_init+0x0/0xf returned 0 after 2902 usecs
calling  sysctl_ipv4_init+0x0/0x71 @ 1
initcall sysctl_ipv4_init+0x0/0x71 returned 0 after 274 usecs
calling  init_syncookies+0x0/0x16 @ 1
initcall init_syncookies+0x0/0x16 returned 0 after 31 usecs
calling  ah4_init+0x0/0x63 @ 1
initcall ah4_init+0x0/0x63 returned 0 after 2 usecs
calling  esp4_init+0x0/0x63 @ 1
initcall esp4_init+0x0/0x63 returned 0 after 1 usecs
calling  tunnel4_init+0x0/0x63 @ 1
initcall tunnel4_init+0x0/0x63 returned 0 after 1 usecs
calling  ipv4_netfilter_init+0x0/0x10 @ 1
initcall ipv4_netfilter_init+0x0/0x10 returned 0 after 1 usecs
calling  ip_tables_init+0x0/0x8d @ 1
ip_tables: (C) 2000-2006 Netfilter Core Team
initcall ip_tables_init+0x0/0x8d returned 0 after 3935 usecs
calling  iptable_mangle_init+0x0/0x40 @ 1
=============================================================================
BUG kmalloc-1024: Poison overwritten
-----------------------------------------------------------------------------

INFO: 0xbd542464-0xbd54246f. First byte 0x0 instead of 0x6b
INFO: Allocated in ops_init.constprop.5+0x4a/0xe0 age=186 cpu=1 pid=1
INFO: Freed in ops_free+0x2a/0x30 age=168 cpu=1 pid=1
INFO: Slab 0xbf818800 objects=15 used=8 fp=0xbd542180 flags=0x3d0040c1
INFO: Object 0xbd542180 @offset=8576 fp=0xbd5425b0

Bytes b4 0xbd542170:  00 00 00 00 00 00 00 00 5a 5a 5a 5a 5a 5a 5a 5a ........ZZZZZZZZ
  Object 0xbd542180:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542190:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5421a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5421b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5421c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5421d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5421e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5421f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542200:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542210:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542220:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542230:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542240:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542250:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542260:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542270:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542280:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542290:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5422a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5422b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5422c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5422d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5422e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5422f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542300:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542310:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542320:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542330:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542340:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542350:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542360:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542370:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542380:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542390:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5423a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5423b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5423c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5423d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5423e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5423f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542400:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542410:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542420:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542430:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542440:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542450:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542460:  6b 6b 6b 6b 00 5c 26 05 e0 75 54 bd 80 14 c1 81 kkkk.\&.�uT�..�.
  Object 0xbd542470:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542480:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542490:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5424a0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5424b0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5424c0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5424d0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5424e0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd5424f0:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542500:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542510:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542520:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542530:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542540:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542550:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542560:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b kkkkkkkkkkkkkkkk
  Object 0xbd542570:  6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 kkkkkkkkkkkkkkk�
 Redzone 0xbd542580:  bb bb bb bb                                     ����            
 Padding 0xbd5425a8:  5a 5a 5a 5a 5a 5a 5a 5a                         ZZZZZZZZ        
Pid: 1, comm: swapper Not tainted 2.6.38-tip-08708-g9ad1933-dirty #109548
Call Trace:
 [<8109919b>] print_trailer+0xab/0x110
 [<8109932c>] check_bytes_and_report+0xdc/0x120
 [<8109a04b>] check_object+0x1db/0x230
 [<81098dbb>] ? check_valid_pointer+0x2b/0x60
 [<818bb338>] alloc_debug_processing+0x74/0xf2
 [<8102f834>] ? __call_console_drivers+0x64/0x80
 [<818bb878>] __slab_alloc.constprop.18+0x1a3/0x1fd
 [<81792dc1>] ? ipt_alloc_initial_table+0x31/0x1b0
 [<81792dc1>] ? ipt_alloc_initial_table+0x31/0x1b0
 [<8109b11a>] __kmalloc+0xca/0x100
 [<81792dc1>] ipt_alloc_initial_table+0x31/0x1b0
 [<81c74fa5>] iptable_mangle_net_init+0x11/0x4c
 [<816f89ef>] ops_init.constprop.5+0x2f/0xe0
 [<8173e5ea>] ? xt_register_match+0x4a/0x60
 [<816f8ae3>] register_pernet_operations+0x43/0x80
 [<816f8b8c>] register_pernet_subsys+0x1c/0x30
 [<81c74fee>] iptable_mangle_init+0xe/0x40
 [<81c3881e>] do_one_initcall+0x51/0x134
 [<81c74fe0>] ? iptable_mangle_init+0x0/0x40
 [<81c74fe0>] ? iptable_mangle_init+0x0/0x40
 [<81c38a2a>] kernel_init+0x129/0x1b5
 [<81c38901>] ? kernel_init+0x0/0x1b5
 [<818c907e>] kernel_thread_helper+0x6/0xd
FIX kmalloc-1024: Restoring 0xbd542464-0xbd54246f=0x6b

FIX kmalloc-1024: Marking all objects used
usb usb2: rpm_suspend flags 0x9
usb usb2: rpm_suspend returns 0
initcall iptable_mangle_init+0x0/0x40 returned 0 after 674576 usecs
calling  ulog_tg_init+0x0/0xe2 @ 1
initcall ulog_tg_init+0x0/0xe2 returned 0 after 9 usecs
calling  cubictcp_register+0x0/0x73 @ 1
TCP cubic registered
initcall cubictcp_register+0x0/0x73 returned 0 after 1879 usecs
calling  xfrm_user_init+0x0/0x41 @ 1
Initializing XFRM netlink socket
initcall xfrm_user_init+0x0/0x41 returned 0 after 2914 usecs
calling  inet6_init+0x0/0x27f @ 1
NET: Registered protocol family 10
initcall inet6_init+0x0/0x27f returned 0 after 6231 usecs
calling  ah6_init+0x0/0x63 @ 1
initcall ah6_init+0x0/0x63 returned 0 after 1 usecs
calling  esp6_init+0x0/0x63 @ 1
initcall esp6_init+0x0/0x63 returned 0 after 2 usecs
calling  ipcomp6_init+0x0/0x63 @ 1
initcall ipcomp6_init+0x0/0x63 returned 0 after 1 usecs
calling  xfrm6_tunnel_init+0x0/0xc5 @ 1
initcall xfrm6_tunnel_init+0x0/0xc5 returned 0 after 141 usecs
calling  tunnel6_init+0x0/0x63 @ 1
initcall tunnel6_init+0x0/0x63 returned 0 after 1 usecs
calling  xfrm6_transport_init+0x0/0x14 @ 1
initcall xfrm6_transport_init+0x0/0x14 returned 0 after 2 usecs
calling  xfrm6_mode_tunnel_init+0x0/0x14 @ 1
initcall xfrm6_mode_tunnel_init+0x0/0x14 returned 0 after 1 usecs
calling  xfrm6_ro_init+0x0/0x14 @ 1
initcall xfrm6_ro_init+0x0/0x14 returned 0 after 1 usecs
calling  mip6_init+0x0/0xb4 @ 1
Mobile IPv6
initcall mip6_init+0x0/0xb4 returned 0 after 1116 usecs
calling  ip6_tables_init+0x0/0x8d @ 1
ip6_tables: (C) 2000-2006 Netfilter Core Team
initcall ip6_tables_init+0x0/0x8d returned 0 after 4010 usecs
calling  nf_conntrack_l3proto_ipv6_init+0x0/0xd9 @ 1
initcall nf_conntrack_l3proto_ipv6_init+0x0/0xd9 returned 0 after 93 usecs
calling  nf_defrag_init+0x0/0x4a @ 1
initcall nf_defrag_init+0x0/0x4a returned 0 after 23 usecs
calling  log_tg6_init+0x0/0x24 @ 1
initcall log_tg6_init+0x0/0x24 returned 0 after 1 usecs
calling  sit_init+0x0/0x52 @ 1
IPv6 over IPv4 tunneling driver
initcall sit_init+0x0/0x52 returned 0 after 3741 usecs
calling  packet_init+0x0/0x39 @ 1
NET: Registered protocol family 17
initcall packet_init+0x0/0x39 returned 0 after 3078 usecs
calling  ipsec_pfkey_init+0x0/0x69 @ 1
NET: Registered protocol family 15

Re: [slab poison overwritten] Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-22 09:57:11

* Eric Dumazet [off-list ref] wrote:
[PATCH] ipvs: fix a typo in __ip_vs_control_init()
This fix and Simon's:

  IPVS: Use global mutex in ip_vs_app.c

Did the trick here, the IPVS related SLAB corruptions are now gone.

Thanks guys!

	Ingo

Re: [GIT] Networking

From: Ingo Molnar <hidden>
Date: 2011-03-22 10:00:26

* Linus Torvalds [off-list ref] wrote:
On Sun, Mar 20, 2011 at 7:51 PM, David Miller [off-list ref] wrote:
quoted
1) The R8169 PHY fix from Eric Dumazet, which I see you've added to
  your tree too. :-)
Yeah, since my machine didn't have networking without it, and I could
test it myself, I didn't wait to pull.

That said, I'm delaying this pull request due to the known issues with
it - let me know when you've updated it with the fix for the
use-after-free fixes and the slab corruptor (the latter of which I
haven't seen a patch for yet)
All problems i was able to trigger in this area are fixed by these patches:

 ipvs: Fix a typo in __ip_vs_control_init()
 IPVS: Use global mutex in ip_vs_app.c
 ipx: Fix ipx_release()
 net/appletalk: fix atalk_release use after free

Thanks,

	Ingo

Re: [slab poison overwritten] Re: [GIT] Networking

From: Eric Dumazet <hidden>
Date: 2011-03-22 10:00:48

Le mardi 22 mars 2011 à 10:56 +0100, Ingo Molnar a écrit :
* Eric Dumazet [off-list ref] wrote:
quoted
[PATCH] ipvs: fix a typo in __ip_vs_control_init()
This fix and Simon's:

  IPVS: Use global mutex in ip_vs_app.c

Did the trick here, the IPVS related SLAB corruptions are now gone.

Thanks guys!
Thanks for testing Ingo ;)


Re: [slab poison overwritten] Re: [GIT] Networking

From: Simon Horman <horms@verge.net.au>
Date: 2011-03-22 21:52:57

On Tue, Mar 22, 2011 at 11:00:39AM +0100, Eric Dumazet wrote:
Le mardi 22 mars 2011 à 10:56 +0100, Ingo Molnar a écrit :
quoted
* Eric Dumazet [off-list ref] wrote:
quoted
[PATCH] ipvs: fix a typo in __ip_vs_control_init()
This fix and Simon's:

  IPVS: Use global mutex in ip_vs_app.c

Did the trick here, the IPVS related SLAB corruptions are now gone.

Thanks guys!
Thanks for testing Ingo ;)
Yes, thanks Ingo.
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help