kernel-fxtec-pro1x/net/rds
Chris Mason 6fa70da608 rds: recycle FMRs through lockless lists
FRM allocation and recycling is performance critical and fairly lock
intensive.  The current code has a per connection lock that all
processes bang on and it becomes a major bottleneck on large systems.

This changes things to use a number of cmpxchg based lists instead,
allowing us to go through the whole FMR lifecycle without locking inside
RDS.

Zach Brown pointed out that our usage of cmpxchg for xlist removal is
racey if someone manages to remove and add back an FMR struct into the list
while another CPU can see the FMR's address at the head of the list.

The second CPU might assume the list hasn't changed when in fact any
number of operations might have happened in between the deletion and
reinsertion.

This commit maintains a per cpu count of CPUs that are currently
in xlist removal, and establishes a grace period to make sure that
nobody can see an entry we have just removed from the list.

Signed-off-by: Chris Mason <chris.mason@oracle.com>
2010-09-08 18:15:28 -07:00
..
af_rds.c
bind.c
cong.c
connection.c rds: fix rds_send_xmit() serialization 2010-09-08 18:15:27 -07:00
ib.c
ib.h RDS/IB: Add caching of frags and incs 2010-09-08 18:15:23 -07:00
ib_cm.c RDS/IB: Add caching of frags and incs 2010-09-08 18:15:23 -07:00
ib_rdma.c rds: recycle FMRs through lockless lists 2010-09-08 18:15:28 -07:00
ib_recv.c RDS: use friendly gfp masks for prefill 2010-09-08 18:15:24 -07:00
ib_ring.c
ib_send.c rds: fix rds_send_xmit() serialization 2010-09-08 18:15:27 -07:00
ib_stats.c
ib_sysctl.c
info.c
info.h
iw.c
iw.h
iw_cm.c
iw_rdma.c
iw_recv.c
iw_ring.c
iw_send.c
iw_stats.c Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu 2009-09-15 09:39:44 -07:00
iw_sysctl.c
Kconfig
loop.c
loop.h
Makefile
message.c
page.c RDS: Use page_remainder_alloc() for recv bufs 2010-09-08 18:15:20 -07:00
rdma.c
rdma_transport.c
rdma_transport.h
rds.h rds: fix rds_send_xmit() serialization 2010-09-08 18:15:27 -07:00
recv.c
send.c rds: fix rds_send_xmit() serialization 2010-09-08 18:15:27 -07:00
stats.c
sysctl.c
tcp.c
tcp.h
tcp_connect.c
tcp_listen.c
tcp_recv.c
tcp_send.c
tcp_stats.c
threads.c rds: fix rds_send_xmit() serialization 2010-09-08 18:15:27 -07:00
transport.c
xlist.h rds: recycle FMRs through lockless lists 2010-09-08 18:15:28 -07:00