Page 1 of 1
GOOGLE or the real heaven of a programmer
Posted: Sat Apr 06, 2013 7:37 pm
by Kwai chang caine
Re: GOOGLE or the real heaven of a programmer
Posted: Sat Apr 06, 2013 7:45 pm
by Kiffi
and the Data-Center is guarded by Stormtroopers:
http://drewbmac.files.wordpress.com/201 ... .jpg?w=960
Greetings ... Kiffi
Re: GOOGLE or the real heaven of a programmer
Posted: Sat Apr 06, 2013 9:13 pm
by Shield
Saw some of those pictures in a presentation at the university held by one
of the network heads at Google.
Was pretty darn interesting and fascinating
to hear how they handle the massive amount of incoming request and the constant
hardware failures.
Re: GOOGLE or the real heaven of a programmer
Posted: Sun Apr 07, 2013 12:16 am
by tj1010
I always thought they used low-energy PCIe boards in special blade configurations. This looks like a typical data center with typical blades...
I tend to make fun of how companies like Google and MS have armies of the best minds and talent in the world, only to maintain the most bland line of rehashed ideas... Tens of thousands of award winning developers only to copy designs and ideas based on market trends. It's like hiring a physicist to design yo-yos or rubber toy balls..
Re: GOOGLE or the real heaven of a programmer
Posted: Sun Apr 07, 2013 1:57 am
by MachineCode
Not that I plan too, but bombing the data center in this pic would effectively destroy Google?
Re: GOOGLE or the real heaven of a programmer
Posted: Sun Apr 07, 2013 2:46 am
by Shield
Re: GOOGLE or the real heaven of a programmer
Posted: Sun Apr 07, 2013 2:49 am
by MachineCode
Didn't realise there were more than one.
Re: GOOGLE or the real heaven of a programmer
Posted: Mon Apr 08, 2013 3:10 am
by tj1010
They use fail-over clustering with multiple data-centers. I think they do have a centralized data-center for development that partially syncs to partner and other dev centers. Ddos and manipulating data has no lasting affect unless you dump accounts and/or source code and lower their worth on trade markets, but still a little dent they recover from inside a couple months..
It's just like all other big companies.
Also I think the heaven for programmers would be IBM or RSA or a space or defense program where there is original products and research... Google raids popular markets starting with search engines and just uses better marketing, and just hires massive amounts of people to reduce turn-around... I know extremely talented physicists and engineers who worked there and MS and did nothing but quality assurance and market consulting...
Re: GOOGLE or the real heaven of a programmer
Posted: Mon Apr 08, 2013 8:50 pm
by Kwai chang caine
Re: GOOGLE or the real heaven of a programmer
Posted: Thu Apr 11, 2013 1:34 pm
by Zach
I really am surprised at some of the inefficiency... hundreds of tiny fans to move air away from the server?
Good god, you have the money, invest in some custom back panels that use larger radius fans. I'm surprised they don't use some kind of custom "cluster" container holding X amount of servers and using a blow to draw the air out (negative pressure) into and down those cooling corridors.
Even just changing it to larger fans would mean less noise (less RPM), less power (less fans), etc.. Even if they chose to run them faster (louder, more power), for the same power draw you'd probably get better performance.
Re: GOOGLE or the real heaven of a programmer
Posted: Fri Apr 12, 2013 12:39 am
by tj1010
Zach wrote:I really am surprised at some of the inefficiency... hundreds of tiny fans to move air away from the server?
Good god, you have the money, invest in some custom back panels that use larger radius fans. I'm surprised they don't use some kind of custom "cluster" container holding X amount of servers and using a blow to draw the air out (negative pressure) into and down those cooling corridors.
Even just changing it to larger fans would mean less noise (less RPM), less power (less fans), etc.. Even if they chose to run them faster (louder, more power), for the same power draw you'd probably get better performance.
That's ~1/19 of their server rooms and you're talking about a company who hires physicists and world class engineers to do quality assurance on web UI...
Years back they were using PCIe back-pane with low-clock AMD stuff in their HTTP infrastructure.
Re: GOOGLE or the real heaven of a programmer
Posted: Mon Apr 15, 2013 10:00 am
by Zach
Still, it just boggles my mind from the perspective of them already investing so much for their own internal power grid that runs off renewable energy
Re: GOOGLE or the real heaven of a programmer
Posted: Thu May 02, 2013 9:34 pm
by blueznl
For those interested: I'm working in this field, doing some datacenter stuff (buildings, cooling, power, not the stuff IN the racks, I'm a utility guy, not an IT person
)
http://erdsjb.free.fr/PureStorage/Provi ... oogle2.jpg
Definitely NOT the best use of space, in spite of Google's comment. Look at the large pathways, and the amount of vertical space wasted. I frankly don't understand the cooling concept on that image. It might be a cold isle, but what's all that stuff doing on top of the racks? Could be the same center as image number 6.
http://erdsjb.free.fr/PureStorage/Provi ... oogle4.jpg
This one I've seen before. Nice use of colors for the different sections of piping. Makes identifying easier. I just love how much space Google has to setup their datacenters. The ones I'm involved with are typically much smaller, and have way less space...
http://erdsjb.free.fr/PureStorage/Provi ... oogle5.jpg
Custom Google boards. Those colors are only added for marketing purposes.
http://erdsjb.free.fr/PureStorage/Provi ... ogle6..jpg
This picture is more interesting. All those mini fans are probably mounted on the back of the custom Google main boards, ie. if a board fails, or a fain fails, then swap the whole board. If there were single, large fans behind you would not be able to replace that specific fan (too dangerous in there). The flexible tubes going up are probably hot and cold flex piping, ie. cold water towards the top mounted heat exchanger, and warm water out again. The steel structure could be improved a bit to allow engineers easier access to the piping and exchangers.
http://erdsjb.free.fr/PureStorage/Provi ... oogle7.jpg
This picture is less clear, but I suspect hot isle / cold isle separation using those plastic flaps. If that isn't a raised floor (the image would suggest it isn't) I guess that's in-row cooling in the image above.
http://erdsjb.free.fr/PureStorage/Provi ... ogle10.jpg
Just a water tank, typically used to buffer water for a few minutes in case there is a power loss and the chillers need to restart on generators. Largish, but not really special.
