I finished off the physical design for the MDF and IDFs a while ago and thought I would take the time to post these in case you wanted to build your own 3000 person corporate conference at home. I am only covering off the network side of things below – there is a massive HP + Microsoft private cloud solution going in at the event that will need post(s) in its own right.

In terms of fast Internets

• 1000 mbps of Internet connectivity provided by Telstra Internet Direct. This is a high performance e-line service back to Telstra Internet Direct in the Charlotte St exchange (i.e. it is a wholesale/service-provider quality service, uncontended back to their core).
• An additional 500 mbps of Internet connectivity from Over The Wire as a redundancy option.
• BGP routing under our own AS9984 to make the best use of the combined link.
• IPv4 and IPv6.

In terms of WiFi

• Cisco 5508 WLC
• 50 x Cisco Aironet 1252 access points
• Each AP has 2 x radio interfaces (2.4 and 5GHz) for a total of 100 radios supporting 802.11a, b, g, and n

In terms of physical infrastructure

• 2 x Brocade CER units for core routing
• 2 gbps LACP core trunking between the routers, core switches and wireless LAN controller
• 1 gbps distribution network
• 77 switches deploying 2000+ ports of connectivity

IDF Physical Design

MDF Physical Design

Also available as a PDF export of the original VSD:

Project 3031 – Tech·Ed 2011 Network Design and Implementation (Microsoft Pty Ltd) – Network Design

If you have any questions then post them below.

Everyone loves fast Internets. Providing really fast Internets at tech•ed this year has provide to be a complete pain in the proverbial.

Give, and ye shall receive (unfortunately)

The Gold Coast Convention and Exhibition Centre has a permanent 100 meg service to Telstra Internet Direct. We know from last year that we were saturating the 100 meg service at the Sydney Convention Centre (we actually put on more bandwidth during the event) and so with that experience, and 2500 people wanting to download the lastest build of Chrome Vizact we know we’re in for a rough time if that is the only connectivity option available to us.

Our first port of call was obviously upgrading the service in the building. We learned however that that would require an infrastructure upgrade from Southport back to Brisbane. The original estimate for this was … lets just say well and truly out of our price range (we could have bought another 2500 netbooks, but we did manage to get it reduced significantly) however with the GFC and what not there is no way we could budget in the hundreds of thousands of dollars to ramp a 100 meg service up to a 500 meg service.

As luck would have it (or not as you will learn), On The Net has a dedicated DWDM fibre service in the City Pac building at 2 Miama Keys (next door, more or less). In the past few weeks we managed to do the following:

• Gain an agreement from On The Net that we could use the service in the City Pac building and that they would provide a fully managed layer 2 service from there back to Pipe Network’s DC3 or DC2 in Brisbekistan. Once you’re in a Pipe facility your connectivity options are opened up considerably as they’re telco neutral.
• Gain approval from Gold Coast City Council together with an affordable cabling estimate for us to run temporary fibre from the convention centre, across the bridge that connects T.E. Peter’s Drive to the little island to the left of the convention centre, and then hop off that onto a council light pole and into City Pac.
• Over The Wire then organised temporary upgrades with connectivity for the Australian Partner Conference and then a burst up to 300 mbps for the duration of tech•ed. Brent Paddon from Over The Wire had even orgnised some temporary upgrades on the Brisbane to Sydney intercapital link from one of their upstream providers for us.
• We received a verbal agreement from City Pac for access to their MDF and data centre.

“Sounds Great!” I hear you say … “What could possibly go wrong?”

City Pac went into receivership on the 31st of July.

I’ve spent the last week grovelling to the morticians at PPB Receivers who are doing the wind up (nice folk, Receivers … not). We’ve tried everything including offering to rent the space, providing an indemnification from Microsoft. David Haysom even tried to get a call set up between Gianpaolo Carraro (Microsoft’s DPE Director) and the CEO/MD of PPB – no dice. They just want to put the place on the market.

It is an understatement to say that I am annoyed that the team had the entire shooting match organised and we’ve come unstuck at the door to an MDF across the road from the convention centre.

Where to now?

I’ve spent pretty much the last ten days with a phone stuck to my head and talked with everyone with an Internet we can use. A number of options have surfaced, two of which are reasonably firm committments from a supplier that we can do 400mbps microwave from the comms deck at the convention centre to here:

Corporate Centre 1 as seen from the Gold Coast Convention Centre communications deck.

We’d jump onto the roof of that place, then do another microwave link across to Royal Pines. The other plan is we do more or less the same thing to get to Austar’s building. Both of those facilities can provide the fibre back to Brisbane.

There is a final terrestrial option that we are exploring in the next few days and I’d really like to see that come to fruition over using a radio solution. I’ll post an update if we manage to pull that off.

If we do end up with a radio solution to get the extra bandwidth, knowing our luck of late we’ll end up with a freak dust storm/storm/aliens attacking during the show.

The fallback scenario is of course the Telstra Internet Direct service that is already there – and that is not a bad outcome however it might mean congestion at peak break times.

Anyway, we have plans hatching and I’m sure we’ll be able to pull something off.

We’ve not been defeated at a tech•ed yet … though this one is trying my patience.

we shall fight on the comms deck, we shall fight in the IDFs and in the MDFs, we shall fight in the data centres; we shall never surrender.