Koozali.org: home of the SME Server

Proxy slows down fast connection

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #15 on: June 18, 2009, 11:54:54 AM »
Nothing i get announcement:

Operationeel status rapport
ect....

"Which equals
12.5Mbyte / 2 = 6.25MByte
So the best you could possibly get is 6.25Mbyte (if the sun is shining) and thats if you don't consider any thing else in the real networking world."

Nice thinking but with proxy OFF,.. i get the full speed of 11,4MByte.




Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #16 on: June 18, 2009, 07:05:11 PM »
Nothing i get announcement:

Operationeel status rapport
ect....

"Which equals
12.5Mbyte / 2 = 6.25MByte
So the best you could possibly get is 6.25Mbyte (if the sun is shining) and thats if you don't consider any thing else in the real networking world."

Nice thinking but with proxy OFF,.. i get the full speed of 11,4MByte.

Again you confirmed the theory.

So the proxy you setup points to a server I assume on SME's Lan address space, is that correct.

Offline mmccarn

  • *
  • 2,657
  • +10/-0
Re: Proxy slows down fast connection
« Reply #17 on: June 19, 2009, 06:58:24 PM »
...I have a fast internet connection 100Mbit up and download. (Optical Fiber)

According to the pfSense Hardware Sizing Guidance:
Quote
Throughput Considerations

If you require less than 10 Mbps of throughput, you can get by with the minimum requirements. For higher throughput requirements we recommend following these guidelines, based on our extensive testing and deployment experience. These guidelines offer a bit of breathing room because you never want to run your hardware to its full capacity.

10-20 Mbps - No less than 266 MHz CPU
21-50 Mbps - No less than 500 MHz CPU
51-200 Mbps - No less than 1.0 GHz CPU
201-500 Mbps - server class hardware with PCI-X or PCI-e network adapters, or newer desktop hardware with PCI-e network adapters. No less than 2.0 GHz CPU.
501+ Mbps - server class hardware with PCI-X or PCI-e network adapters. No less than 3.0 GHz CPU.

which I read to say "get a faster CPU" for your 100Mbps connection...  ;-)

Offline Normando

  • *
  • 841
  • +2/-1
    • Unixlan
Re: Proxy slows down fast connection
« Reply #18 on: June 20, 2009, 08:54:33 AM »
Nice thinking but with proxy OFF,.. i get the full speed of 11,4MByte.

You must use a faster CPU with a faster HD. This is the problem in your server. Your slow CPU and slow HD is a bottleneck, so in your server is better switching off the proxy, or upgrade the hardware.

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #19 on: June 20, 2009, 09:44:26 AM »
Yes i think to that a faster CPU and HD solves the problem.
Thanks all for your advice!

Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #20 on: June 21, 2009, 04:28:30 AM »
According to the pfSense Hardware Sizing Guidance:
which I read to say "get a faster CPU" for your 100Mbps connection...  ;-)
The above chart considers multiple connections, this issue involves only 2 plus whatever is current at time of testing.

At the CL enter...
top or htop
That will help you determine if your CPU is taxed or overloaded.

iptraf
Will allow you to monitor eth1 traffic and will show the number of  simultaneous connections thru eth1.
Don't be surprised if the list gets long.
You can monitor all traffic thru both eth0 & eth1 at the same time also.

You can open two shells and run both top and iptraf at the same time.
Should give you a clear picture as to where the problem lies.

Linux has many tools for diagnosing problems, always a good idea to become familiar with them and the info they provide.

Scenario 1 Gateway Mode
Source Request > SME WEB IP (via SME's external interface 100Mbit NIC connection 1) >>> Proxy SME's Gateway IP (via SME's internal interface 100Mbit??? NIC connection 2)

1 connection thru SME's external interface 100Mbit NIC.
Max Bandwidth for the 1 connection thru that interface = 12.5MByte or there a bouts.

Scenario 2 Gateway or Server Only Mode
Source Request > SME WEB IP (via SME's external  interface 100Mbit connection 1) >>> to Proxy Remote IP (via SME's  EXTERNAL 100Mbit connection 2)

2 connections thru SME's external interface 100Mbit NIC.

Max 100T NIC is 100Mbit = 12.5MByte

Which equals
12.5Mbyte / 2 = 6.25MByte
So the best you could possibly get is 6.25Mbyte and that's if you don't consider any thing else in the real networking world.

So let's correct it for the newly/recently presented real data of 11.4
11.4 / 2 = 5.7MBytes
Subtract some for the connection to the test server and some for the usual network comm stuff.
Let's say for round numbers 0.7Mbyte.....we now get....
5.7 - 0.7 = 5.0 MByte

5.0 MByte

The reported speeds slows down to 4-4,5Mbyte.

I'd say, your in the ball ParK +/- a few bitty Bytes.

Quote
Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbit

Quote

Quote
That's about right for server-only mode.

It will also be right in Gateway mode IF you proxy off the server to a remote IP addy.
1 inbound connection for Wan and 1 outbound connection to the remote IP thru the external interface nic.

2 connections thru the external interface nic.
Thus the bandwidth is approx 11.4 / 2 = 5.7MBytes

or

Gateway mode proxy to local gateway IP.
1 inbound connection for Wan and local proxy (routed to GW interface) no outbound external connection to the remote IP.

1 connections thru the external interface nic.
Thus the bandwidth is approx 11.4MBytes or max bandwidth available at the current time.

Surely it doesn't hurt to upgrade the system to a faster CPU to sustain additional proxy connections, however
the bottleneck will still be the 100Mbit nic if that is not upgraded.

My experience is years back 400MHZ CPU and 1000Mbit nic will handle 12-16 connections fairly well, the performance then
becomes a function of the Wan bandwidth and speed of the Harddisk.

Since you already have a gigabit router, a gigabit nic will be a lot less then a new system for sure.
Intel gigabit nic works very well with SME, the Intel server motherboard we use have daul Intel nic's built in.

At any one given time the server here has 10-80 connections, at this very moment 13 connections thru eth1 open and 1 passing constant packets
due to a remote shell connection.

If you place a large file i.e. an iso on your remote server and setup multiple downloads simultaneously you can monitor what is happening.

Understanding is in the mind of the beholder. YMMV

HTH

Offline mercyh

  • *
  • 824
  • +0/-0
    • http://mercyh.org
Re: Proxy slows down fast connection
« Reply #21 on: June 29, 2009, 03:32:10 PM »
Why would you wish to proxy such a fast connection?

Generally proxy is used to speed up a slow connection, limit total bandwidth usage (by caching redundant downloads) or for filtering purposes.

In your case it doesn't look like you need the first two.

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #22 on: June 29, 2009, 03:38:06 PM »
Ooh, i was just testing and wonder why....
Still i can't check the many answers, i have at this moment no fast server available.

Offline mercyh

  • *
  • 824
  • +0/-0
    • http://mercyh.org
Re: Proxy slows down fast connection
« Reply #23 on: June 29, 2009, 03:46:30 PM »
Ooh, i was just testing and wonder why....
Still i can't check the many answers, i have at this moment no fast server available.


Fine,
I was just trying to determine what use a proxy would have on such a connection.

(I think most of us would be a bit jealous of your bandwidth)

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #24 on: June 29, 2009, 04:06:46 PM »
Yes i have lucky, in our street they just made fiberglass possible.
I pay about 45,- euro a month for it.
It's real fast - 1GB - in 00:01:30 seconds (at full speed)
i now have set up a Mirror for the SME Server (ftp://ftp.rgmtechnical.nl/)
i hope the FTP is save ;-)

Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Proxy slows down fast connection
« Reply #25 on: June 29, 2009, 09:01:38 PM »
Yes i have lucky, in our street they just made fiberglass possible.
I pay about 45,- euro a month for it.
It's real fast - 1GB - in 00:01:30 seconds (at full speed)
i now have set up a Mirror for the SME Server (ftp://ftp.rgmtechnical.nl/)
i hope the FTP is save ;-)
Wow, living in the proper part of Holland (at least for fibre)... I am and perhaps need to wait a long time for the glass to reach my doorstep.

Did you report a bug in the bugtracker specifying the details for your mirror so it can be monitored and when deamed stable added to the list of mirrors?
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #26 on: June 29, 2009, 09:37:12 PM »
You live in Maastricht.. Hmm i think in 2025 you have fiber  :eek:
Perhaps you can call reggefiber and ask them when Maastricht have fiber.

Mirror: The FTP site is mirrored and i am on the list, ftp://ftp.rgmtechnical.nl/mirrorlist/index.html

Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Proxy slows down fast connection
« Reply #27 on: June 29, 2009, 09:46:33 PM »
You live in Maastricht.. Hmm i think in 2025 you have fiber  :eek:
Perhaps you can call reggefiber and ask them when Maastricht have fiber.
So that means there is fibre outside of Amsterdam as well... we are slowly getting somewhere in our small country with (one of) the highest densities of internet connections. Perhaps I should have stayed in Twente, if only someone had a proper job for me back then :-)


Mirror: The FTP site is mirrored and i am on the list, ftp://ftp.rgmtechnical.nl/mirrorlist/index.html
I know but the proper channel to announce your mirror and have it taken up in the monitor system is to open a bug for it in the bugtracker, so please do so.
« Last Edit: June 29, 2009, 09:48:11 PM by cactus »
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #28 on: June 30, 2009, 02:47:55 PM »
"I know but the proper channel to announce your mirror and have it taken up in the monitor system is to open a bug for it in the bugtracker, so please do so."

Well, i did... and this was the result.. ;-)

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #29 on: August 05, 2009, 02:00:34 PM »
Oke (few weeks later) i now have another server installed.
CPU 3Ghz
1GB internal memory
etc..
Still using 12Mbyte (100Mb-it) local and internet eht0 - eth1

And now the conclusion:
I can now download and upload with -almost- 12Mbyte with proxy On!
So yes indeed it had to do with hardware!

SME Server is the Best!  :P