[SAC] Re: OSL VLAN 113 Question

Committees SAC mailing list
1

I got this question from OSUOSL today. Anyone want to look into how much
actual data is being served and what it is on download.osgeo?

Thanks,
Alex

-------- Forwarded Message --------
Subject: Re: OSL VLAN 113 Question
Date: Fri, 2 Oct 2015 18:35:17 -0700
From: Justin Dugger <jldugger@osuosl.org>
To: tech@wildintellect.com
CC: Lance Albertson <lance@osuosl.org>, Jordan Evans
<jordane@osuosl.org>, systems@osuosl.org <systems@osuosl.org>

Alex,

The report NERO provided us suggests that OSGEO is pushing about 8 TB
of traffic in the 8 days of the report:
Top 10 Src IP Addr ordered by bytes:
Date first seen Duration Proto Src IP Addr Flows(%)
   Packets(%) Bytes(%) pps bps bpp
2015-09-14 08:54:59.587 691788.598 any 140.211.15.132 1.5 M(
1.4) 4.8 G(47.0) 7.0 T(57.0) 6883 80.9 M 1469
2015-09-14 08:55:16.573 691779.802 any 140.211.15.67 2.6 M(
2.4) 674.2 M( 6.7) 955.3 G( 7.8) 974 11.0 M 1416

Does this seem realistic? Your awstats chart claims about 100G a month.

Network usage on this VLAN is getting saturated, to the point that
pingdom checks are timing out for HTTP services on occasions where
thresholds are crossed.

--
Justin Dugger
Senior Systems Administrator
OSU Open Source Lab

On Thu, Sep 24, 2015 at 9:48 AM, Stephen Fromm <stephenf@nero.net> wrote:

On Tue, 2015-09-22 at 09:21:58 -0700, Lance Albertson wrote:

On Tue, Sep 22, 2015 at 9:15 AM, Stephen Fromm <stephenf@nero.net> wrote:

Is the top N for the last week sufficient?

Yes

And are you interested in

just top bandwidth consumers or traffic consumption in both

directions (egress & ingress)?

Which ever we're hitting the transit limit at although I guess knowing
both would be nice.

My apologies for the late followup. The jobs took awhile to run and I
forgot about them.

Attached are two files:

- osuosl-vlan113-egress.txt
- osuosl-vlan113-ingress.txt

The egress file is traffic from NERO to OSUOSL; ingress is traffic from
OSUOSL to NERO. The time period is 2015-09-14 09:00 to 2015-09-22
09:00.

Please let us know if you have any questions.

--
Stephen Fromm
Network for Education and Research in Oregon

2

On Fri, Oct 02, 2015 at 07:53:16PM -0700, Alex Mandel wrote:

I got this question from OSUOSL today. Anyone want to look into how much
actual data is being served and what it is on download.osgeo?

  http://webextra.osgeo.osuosl.org/munin/osgeo.org/download.osgeo.org/apache_volume.html

  http://webextra.osgeo.osuosl.org/munin/osgeo.org/download.osgeo.org/if_eth0.html

  Martin.
--
Unix _IS_ user friendly - it's just selective about who its friends are !
--------------------------------------------------------------------------

3

Hi Alex,

On Fri, 02. Oct 2015 at 19:53:16 -0700, Alex Mandel wrote:

On Fri, 2 Oct 2015 at 18:35:17 -0700, Justin Dugger wrote:
> Alex,
>
> The report NERO provided us suggests that OSGEO is pushing about 8 TB
> of traffic in the 8 days of the report:
> Top 10 Src IP Addr ordered by bytes:
> Date first seen Duration Proto Src IP Addr Flows(%)
> Packets(%) Bytes(%) pps bps bpp
> 2015-09-14 08:54:59.587 691788.598 any 140.211.15.132 1.5 M(
> 1.4) 4.8 G(47.0) 7.0 T(57.0) 6883 80.9 M 1469
> 2015-09-14 08:55:16.573 691779.802 any 140.211.15.67 2.6 M(
> 2.4) 674.2 M( 6.7) 955.3 G( 7.8) 974 11.0 M 1416
>
> Does this seem realistic? Your awstats chart claims about 100G a month.

Which one is he referring to?

According to download's awstats there were ~19TB in August[1] and ~22TB in
September[2] (ie. ~5-6 TB in 8 days). And for the 2015-09-14 to 2015-09-21
period the bandwidth in awstats sums up to ~5.81 TB.

On www.norbit.de to which a third of the QGIS windows standalone installer
downloads is redirected to - download handles the other two thirds - we've had
about 8.5 TB of traffic in September. So that adds up.

Jürgen

[1] http://upload.osgeo.org/cgi-bin/awstats.pl?month=08&year=2015&output=main&config=download.osgeo.org&framename=index
[2] http://upload.osgeo.org/cgi-bin/awstats.pl?month=09&year=2015&output=main&config=download.osgeo.org&framename=index

--
Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-31
Dipl.-Inf. (FH) Rheinstraße 13 Fax. +49-4931-918175-50
Software Engineer D-26506 Norden http://www.norbit.de
QGIS release manager (PSC) Germany IRC: jef on FreeNode

4

Unfortunately, due to a stupid typo, I removed major parts of the
history - this is what I was able to preserve:

  http://download.osgeo.org/webalizer/httpd/

  Martin.
--
Unix _IS_ user friendly - it's just selective about who its friends are !
--------------------------------------------------------------------------