Virtual Ethernet - LPAR to LPAR Communications via system backplane
 
*
Welcome, Guest. Please login or register. November 21, 2008, 05:48:03 PM


Login with username, password and session length


Pages: [1]   Go Down
  Print  
Author Topic: Virtual Ethernet - LPAR to LPAR Communications via system backplane  (Read 1162 times)
0 Members and 1 Guest are viewing this topic.
Michael
Administrator
Hero Member
*****
Posts: 526


« Reply #6 on: May 27, 2008, 08:45:06 PM »

Increasing tcp send and recv buffers (and sb_max to permit it) to 2621440 and really getting 9000 mtu sizes - I got 3.59 e+5 using Virtual Ethernet (100000 x 1M bytes in 306 seconds)

Using lhea between two partitions I needed 258 seconds (3.96e+5 bytes/sec)
Logged
dazman
New Member
*
Posts: 3


« Reply #5 on: May 27, 2008, 04:36:19 PM »

Michael, i am out of the office for the next two weeks but when back I will inform on how it goes.
Logged
Michael
Administrator
Hero Member
*****
Posts: 526


« Reply #4 on: May 26, 2008, 08:31:50 PM »

OK. on a P570, with an LPAR with two virtual processors, uncapped, and the following definition on en0: to an LPAR with one dedicated CPU with a similiar en0 configuration.

Quote
# ifconfig en0
en0: flags=1e080863,480<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPR
T,64BIT,CHECKSUM_OFFLOAD(ACTIVE),CHAIN>
        inet 10.6.101.63 netmask 0xffffff00 broadcast 10.6.101.255
         tcp_sendspace 262144 tcp_recvspace 262144 rfc1323 1

I ran the following test:

ftp node2
user root
password root
put "| dd if=/dev/zero bs=1m count=3000000" /dev/null
quit

On the nodes I had topas -i 5 running.

I see about 220K (KBPS) and what appears to be a CPU bound situation. I hope this gives you enough to be able to test. Be sure to compare with a MTU size of 1500 to see what, if any affect it has and CPU load and throughput.

Note: I edited the command - there was a typo and the command did not work as entered.
« Last Edit: May 27, 2008, 07:29:34 AM by Michael » Logged
Michael
Administrator
Hero Member
*****
Posts: 526


« Reply #3 on: May 26, 2008, 07:24:40 PM »

There are a large number of variables that affect IP network throughput. One way to gather a lot of them is to run netpmon and see what the throughput is, whether there is packet overflow, etc..

And I want to be sure that you are using LPAR-LPAR communication via Virtual Ethernet and not via lhea. Further, compare LAN communication with no external adapter (no VIO involved) to one with a VIO involved.

Without a look at your actual configuration, it remains guessing to a certain degree.

The parameters I am think of most right now are: tcp_mssdflt, tcp_nodelay, tcp_recvspace, tcp_sendspace, sb_max - to limit it to the standard tcp socket variables. And this is needed from both systems. I also assume that both systems are in the same IP network (i.e. no routing), etc..
Logged
dazman
New Member
*
Posts: 3


« Reply #2 on: May 26, 2008, 12:48:17 PM »

Hi Michael,

Thanks for responding, I have altered the MTU size from 1500 up to 9000 without seeing any increase in performance. Also added extra CPU as I know network can too be CPU intensive using VIO but not that either. Not sure where to go from here?

Darren
Logged
Michael
Administrator
Hero Member
*****
Posts: 526


« Reply #1 on: May 23, 2008, 07:01:55 PM »

As in all network situations, networking is also CPU bound - however, it may also be that you need to modify your IP buffers, or even something as simple as MTU size.

What MTU size are you using in the Virtual LAN - inter-partition only LAN?
Logged
dazman
New Member
*
Posts: 3


« on: May 22, 2008, 03:29:05 PM »

My company currently have purchased a new Power6 570 and I am consolidating existing Power4 kit onto this new machine.
We are using VIO for our new lpars and this is working fine. However as we can not virtualize tape drives I require 1 HBA for each VIo client to gain access to an ATL to complete backups. Systems are large 300GB + so need to backup a lot of data. As a result a lot of IO drawers are filling up very quickly because of the backup requirement.

I have tried to configure Virtual Ethernet to acheive high data speeds between lpars but the speed I acheive to date is approx 30MBps. I was expecting it to be 300MBps +. If I can acheive such speeds maybe I can do network backup to a LPAR having a HBA, resulting in far less HBA's being required. Anybody gone this route or any experience of similar scenario?
« Last Edit: May 27, 2008, 07:28:13 AM by Michael » Logged
Pages: [1]   Go Up
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC

Valid XHTML 1.0! Valid CSS! Dilber MC Theme by HarzeM
Page created in 0.806 seconds with 18 queries.




eXTReMe Tracker

Terms of Use and Privacy and Security Policies
Copyright 2001-2008 Michael Felt and ROOTVG.NET