Koozali.org: home of the SME Server

Proxy slows down fast connection

Offline Proxy

  • **
  • 28
  • +0/-0
Proxy slows down fast connection
« on: June 13, 2009, 11:23:15 PM »
Hi there,

I have a fast internet connection 100Mbit up and download. (Optical Fiber)
That's about 12MByte.
Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbyte
Can anyone tell me why?
Is there a setting in the proxy to solve this problem?

I like to hear from you

Best regards,
Proxy


Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Proxy slows down fast connection
« Reply #1 on: June 14, 2009, 09:18:10 AM »
I have a fast internet connection 100Mbit up and download. (Optical Fiber)
That's about 12MByte.
Theoretically yes, but in practice you ill not see that most of the times as part of the data transmission bandwidth is used for sending checksums and doing error corrections in the data stream.

Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbyte
Can anyone tell me why?
Is there a setting in the proxy to solve this problem?
AFAIK speed might be lost due to data analysis but I am not sure it would be that much. AFAIK there is no parameter to work your proxy work faster. It might also depend on hardware the proxy is using an older CPU might have to little procession speed to or seamlessly with the large amount of data you are requesting. It might also be that the upstream provider is not allowing you to use the full 100Mbit bandwidth and it is throttling the connection. You are not giving us enough information to go on.
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #2 on: June 14, 2009, 10:07:43 AM »
Oke here comes more info.

I am using SMEServer v7.4 normal installation.
CPU 800Mhz (Little computer)
512MB Internal memory
20GB Harddisk
1Gbit router D-Link dir-655
100Mbit networkadapter at server and pc
5 PC's are attachted to the server.

The providor is not throttling the connection. it's 100Mbit up and 100Mbit down duplex.
(approximately 1GB download in 00:01:30 seconds)
Maby it's the hardware but... with proxy off it works fine, i get up and downloadspeed to 11,2 - 11,4 MByte.

Do you know if the proxy can handle duplex connections, perhapps that is the problem?


Offline Stefano

  • *
  • 10,894
  • +3/-0
Re: Proxy slows down fast connection
« Reply #3 on: June 14, 2009, 07:50:25 PM »
CPU 800Mhz (Little computer)
512MB Internal memory
20GB Harddisk
1Gbit router D-Link dir-655
100Mbit networkadapter at server and pc
5 PC's are attachted to the server.

you should use a faster cpu if you want to handle such a connection

Ciao
Stefano

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #4 on: June 14, 2009, 08:40:00 PM »
So you think with proxy ON the CPU is to light.
And with proxy OFF it's oke
Hmm,.. maybe possible.. because with proxy ON the load is to much for the poor CPU.


Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #5 on: June 15, 2009, 10:16:13 PM »
Quote
1Gbit router D-Link dir-655
100Mbit networkadapter at server and pc

Are there any servers or pc's using 1000T on the 655 lan ports?????????????

The 655 is really not made to have 10T, 100T and 1000T commingled at the same time, 655 doesn't have buffers required to handle
different rates at the same time efficiently.

Although it will work, performance will be noticeably degraded.

Proxy is a mundane task for SME so 800mhz isn't going to be the issue.

Quote
part of the data transmission bandwidth is used for sending checksums and doing error corrections in the data stream.

Quote
part of the data transmission bandwidth is used for packet checksums and error trapping in the data stream.

The bandwidth loss due to that, will only be an issue if there are packet issues.

Packets are checked for integrity, if trapped bad, they are dropped and a request sent to resend the packet.

With all that said, the problem is likely to be because you might be using Server-Only Mode.

If you are, then that is where your loosing bandwidth performance with a proxy.

Why, because you can't proxy to SME's Lan interface in server-only mode (for obvious reasons), you must create a remote proxy.

When you remote proxy, there are two connections thru the same external interface, that share the bandwidth thru that interface.

The external connection and the proxy connection.

When you proxy to SME's LAN (gateway mode) only one connection is made thru SME's external interface, thus no bandwidth sharing thru the external interface.

Server-Only mode you are bandwidth sharing all connections made thru SME's external interface, whether you want to or not.

hth

That's one of the reasons why Gateway mode is the preferred SME mode.

SME in Gateway mode will run on any network providing you set up the network properly.


Quote
I have a fast internet connection 100Mbit up and download. (Optical Fiber)
That's about 12MByte.
Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbyte

Not byte....bit.

Definitely some confusion there.

Not likely your ISP will give you the same U/D bandwidth with a residential connection.

I assume your FIOS, since you did not mention.

Quote
FiOS Internet Service is the fastest and most powerful connection we've ever offered. With FiOS, you have the choice of several plans to meet your needs. We offer downstream connection speeds (the speed that data is transmitted to your computer) ranging from up to 10 Mbps all the way up to 50 Mbps. We offer upstream speeds up to 20 Mbps in some locations.

If you have their "Faster Plus" plan then your U/D bandwidth is matched 20Mbit not byte.

The "Fastest" plan is not matched U/D.

hth

Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #6 on: June 15, 2009, 11:00:57 PM »
I might add.....

Quote
Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbit

Thats about right for server-only mode.

Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #7 on: June 15, 2009, 11:06:32 PM »
Also goto speedtest.net and you will see your U/D bandwidth.

Large gauge is max bandwidth, small gauge is flow.

hth

Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #8 on: June 16, 2009, 06:12:28 AM »
Also again....

Although a 100T nic does have more then enough bandwidth to handle two 12mbit connections,
some of the older 100T nic's simply don't perform very well.

And of course you have to consider all other simultaneous traffic thru the network.

If you suspect a problem, it's a good idea to do some diag testing, ping, tracert, mtu ping testing
which might shed some light on any problems that may be degrading your results.

hth

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #9 on: June 16, 2009, 12:49:11 PM »
Oke, server is in Gateway-mode not server-only.
Internetconnection is 100 Mbps full duplex. that is about 12,5Mbyte (:8)
With proxy ON speeds drop from 12,5Mbyte (or 11,4 what ever you like)
to 4-4,5Mbyte - not Mbits!
Workstation had nothing to do with it becaurse with proxy OFF it's works fine.

Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Proxy slows down fast connection
« Reply #10 on: June 16, 2009, 12:53:06 PM »
Quote
I have a fast internet connection 100Mbit up and download. (Optical Fiber)
That's about 12MByte.
Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbyte

Not byte....bit.
Nope, in this case the user is right:

100Mbit = 12,5 Mbyte as 1 byte is 8 bits.
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)

Offline mmccarn

  • *
  • 2,657
  • +10/-0
Re: Proxy slows down fast connection
« Reply #11 on: June 16, 2009, 01:47:50 PM »
you should use a faster cpu if you want to handle such a connection

I second neonano's recommendation - try a faster computer for your SME if you need to use the proxy.

My understanding is that the main performance enhancement provided by squid involves keeping local cached copies of thousands of small files.  My home SME, for example, has 20,000 files in /var/spool/squid.

Your proxy server needs to be able to perform high speed calculations (to locate the desired file), high speed disk I/O (to locate and read the requested file) and high speed network communications (to get new cache content and serve that content to your LAN).

So - while I wouldn't be surprised if your 800MHz system could serve websites at 12.5MBytes/sec, it also doesn't surprise me that it doesn't...



Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: Proxy slows down fast connection
« Reply #12 on: June 16, 2009, 05:24:54 PM »
Works fine, till i put on the Proxy, then speeds slows down to 4-4,5Mbyte

How are you measuring that speed? Use of the proxy introduces additional latency,  since the proxy must interpret the request, then search its cache, then send the request upstream and start storing to disk, then start sending the file stream to the client. That takes time. Streaming should be just about as fast once it starts happening.

Offline Proxy

  • **
  • 28
  • +0/-0
Re: Proxy slows down fast connection
« Reply #13 on: June 16, 2009, 07:05:20 PM »
Speed is measured at website below (onsbrabantnet) i download the file 1024MB
OnsBrabantNet is the provider
http://www.glasvezel.nu/speedtest-servers-100mb-1000mb-bin
The file is not stored in cache (i store max 64MB)

"try a faster computer for your SME if you need to use the proxy."
Yes i think also this is the problem, however CPU speed, load etc... are normal, measured by Sysmon.
« Last Edit: June 16, 2009, 07:08:40 PM by Proxy »

Offline electroman00

  • *****
  • 491
  • +0/-0
Re: Proxy slows down fast connection
« Reply #14 on: June 17, 2009, 11:01:39 PM »
Not byte....bit.
Nope, in this case the user is right:

100Mbit = 12,5 Mbyte as 1 byte is 8 bits.

Thanks cactus my friend, but you weren't the fish I was trying to catch.

Quote
Definitely some confusion there.

Where???
Not likely you will actually get 12.5MBytes with a 100Mbit NIC.
So is the number wrong or the multiplier wrong?

Quote
(or 11.4 what ever you like)

Appears the number.
11.4 ......I really do like.
BTW thanks for the multiplier verification also.

For the astute....
Quote
Thats about right for server-only mode.

With 11.4 the calc now works precisely, well as precisely as the measurements and numbers presented.

2 connections thru SME's external interface 100Mbit NIC.

Max 100T NIC is 100Mbit = 12.5MByte

Which equals
12.5Mbyte / 2 = 6.25MByte
So the best you could possibly get is 6.25Mbyte (if the sun is shining) and thats if you don't consider any thing else in the real networking world.

So let's correct it for the newly/recently presented real data of 11.4
11.4 / 2 = 5.7MBytes
Subtract some for the connection to the test server and some for the usual network comm stuff.
Let's say for round numbers 0.7Mbyte.....we now get
5.7 - 0.7 = 5.0 MByte

Hummmm 5.0 MByte

The reported speeds slows down to 4-4,5Mbyte.

I'd say.....Snoopy, were in the ball ParK + / - a few bitty Bytes.

Oh that's right, Proxy said he is using Gateway Mode, so all this is nonsense.

Sorry...my bad.

Interesting, you learn something new every day.

Everyone here, is saying the CPU is the predominate bandwidth controlling hardware device in a computer.

To think, all these years I thought it was the Ethernet Network Interface Card.

So if I by a Cray computer and install a 100Mbit nic, then, the bandwidth problem will be fixed.

Man, I wish I would have known this, we wasted all that money on a new gigabit network.
And we made all those customers upgrade, boy are they going to be mad when they hear this.

I just don't know how such a simple concept could have eluded me for so long.

To think I listened to all the people I thought really knew something.

Cactus your right....
You have to "Be careful whose advice you buy,".....very careful.

Oh well such is life, you live and learn.

Proxy

In Server-Manager under "Hostnames and addresses" what did you select for Location?

hok
« Last Edit: June 18, 2009, 12:20:11 AM by electroman00 »