SolusVM no bandwidth stats on VPS/VM on Xen 4 slave

So I installed SolusVM Slave on a Xen 4 box and everything was working fine (create, reboot, delete, modify VPS/VM) except no bandwidth stats for the individual VMs.

I opened a ticket with SolusVM and it was not apparent what the problem was (to them) so they had me check various things:

1) Please can you run upcp on your Master in SSH

I did that, same results, no bandwidth counting on slave VPS/VM. So they suggest:

In a VPS on a Xen slave please download a large file such as a CentOS DVD and let me know if this counts.

Same thing, so I get frustrated and completely wipe out the Master, reinstall using the

backup database/restore procedure here: http://wiki.solusvm.com/index.php/Moving_The_SolusVM_Master

And everything the same. And now from Solus:

Can you paste me this file please on your master: /usr/local/solusvm/log/bandwidth.log

So it showed no bandwidth counting on the Xen VPS.

I need to see your xen scripts, iptables config and a full output of iptables on the server.

Which showed no bandwidth counting.

I need the output of iptables -L -nxv

Which showed:

3352959 4971885604 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm101.0 –physdev-is-bridged
0        0 ACCEPT     udp  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-in vifvm101.0 –physdev-is-bridged udp spt:68 dpt:67
0        0 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm101.0 –physdev-is-bridged
1514200 82967656 ACCEPT     all  —  *      *       192.1.1.183         0.0.0.0/0           PHYSDEV match –physdev-in vifvm101.0 –physdev-is-bridged
36405 54415322 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm101.0 –physdev-is-bridged
0        0 ACCEPT     udp  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-in vifvm101.0 –physdev-is-bridged udp spt:68 dpt:67
0        0 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm101.0 –physdev-is-bridged
15135   814960 ACCEPT     all  —  *      *       192.1.1.183         0.0.0.0/0           PHYSDEV match –physdev-in vifvm101.0 –physdev-is-bridged
26217  3811598 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm103.0 –physdev-is-bridged
0        0 ACCEPT     udp  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-in vifvm103.0 –physdev-is-bridged udp spt:68 dpt:67
0        0 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm103.0 –physdev-is-bridged
3731   546174 ACCEPT     all  —  *      *       192.1.1.184         0.0.0.0/0           PHYSDEV match –physdev-in vifvm103.0 –physdev-is-bridged
10170503 15208761930 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm102.0 –physdev-is-bridged
0        0 ACCEPT     udp  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-in vifvm102.0 –physdev-is-bridged udp spt:68 dpt:67
0        0 ACCEPT     all  —  *      *       0.0.0.0/0            0.0.0.0/0           PHYSDEV match –physdev-out vifvm102.0 –physdev

So Solus said:

You need to remove the mangle rules. They are stopping data passing over the bridge.

Which sounds reasonable so I:

iptables -F -t mangle

And it stays the same so I say: “What mangle rules?”

And they, in effect, tell me to clear iptables (iptables -F) and then let the Solus process redo them (in 15 minutes) which I did and now iptables is letting bandwidth to go through.

So I searched for the root cause of where those iptables lines were coming from as a

restart brought them back, found them in xen scripts:

# cd /etc/xen/scripts/
# grep physdev *
network-bridge:    iptables -A FORWARD -m physdev –physdev-in ${pdev} -j ACCEPT
vif-common.sh:  iptables “$c” FORWARD -m physdev –physdev-is-bridged –physdev-in “$dev” \
vif-common.sh:  iptables “$c” FORWARD -m physdev –physdev-is-bridged –physdev-out “$dev” \

# rpm -qa | grep xen
xen-libs-4.1.0-2.el5
kernel-xen-2.6.18-238.9.1.el5
xen-4.1.0-2.el5

I commented out those lines and now on a restart the SolusVM Master is able to read bandwidth stats from the individual VPS/VM.

American Express cancelled my High Yield Savings Account!

I have an American Express One Card that I use every month and pay the balance off completely (10 out of 12 months). A while back (actually 6 years ago, August 2006) I noticed they had this “High Yield” savings account options which seemed like it gave reward points for using the One Card. So I decided to test it out and made a very small deposit of $25. Well they paid me interest at higher then the going rate (nevermind, you already know the interest deal these days so no rates are necessary here) and an “Amex Contribution” to the tune of 1% of my One Card usage for that month (qualifying purchases, I never had one that did not qualify)! So I decided to put more money in it and use it as part of my emergency cash plan and use the One Card more systematically then before. So until yesterday I have been doing just that. Built up a reasonable balance in the Savings account (it accounts for one of my 5 or 6 emergency accounts) and received interest and contributions each month. I logged into my One Card account yesterday as I always do to get the tally and look things over and the link to the Savings account is simply gone! I made a phone call to Customer Service and they said they know nothing of it that I need to speak to a different division so they transferred my call. I then spoke with a rep there that said I should have received a letter around 30 days prior, they cancelled that account, and I should be getting a check either tomorrow or next week (he didn’t know which). So I asked the rep “what’s the story?” and he drew a blank so I yelled and he transferred me to a Supervisor who also had no clue but that the Savings to the One Card accounts were a failure so they cancelled them all and sent back all the funds as of yesterday and that it will still accrue interest until the day the check is cut which should be up until the end of November (this month) going from highest balance to lowest so mine should be in the first few batches (my account balance higher then most). I am shocked they could not withdraw their compensation offer without cancelling my savings account, that seems so darn strange it is like being in the Twilight Zone or something. Imagine a financial institution, a bank, just cancelling the client’s accounts and giving back the money! I am still in such a daze I have no idea what else to write about this other then is this also part of what is destroying American (and the world) financially??!

I would not even have made this post except I did a web search about this on Google and found absolutely NOTHING about it, which kept my dazed and confused status alive. Anyone have any comments or information about this to add positive, negative or whatever would be greatly appreciated!

Thank you in advance.

Added 2011-11-05: American Express closes  the ONE High-Yield Savings Account – I still do not see any blog / web posts about this at all, so strange! Anyone???!