cluster computing - Techist - Tech Forum

Go Back   Techist - Tech Forum > Computer Hardware > New Systems | Building and Buying
Click Here to Login
Closed Thread
 
Thread Tools Display Modes
 
Old 03-05-2012, 12:55 AM   #1 (permalink)
Newb Techie
 
Join Date: Feb 2012
Posts: 36
Question cluster computing

Hello community=) i am back with yet another question for the tech gurus of this fantastic forum. Ok, so i have been collecting pc's for a while, i have a few laptops and a desktop which don't have hadd drives and so are useless. I want to cluster these computers to make a really powerful one which i would use mainly for android programming and programming in general. The problem is that it appears that every form of computer cluster is mainly for scientific purposes, is this the only use for computer clusters? Is there a cluster type that i can build for my needs? Thanks guys, i appreciate your help amd time
__________________

xK1LLSW1TCHx127 is offline  
Old 03-05-2012, 05:09 PM   #2 (permalink)
Master Techie
 
Sean W.'s Avatar
 
Join Date: May 2010
Location: Claremont CA.
Posts: 2,095
Default Re: cluster computing

This is definitly possible get your favorite linux flavor and bring up the "man Pages" on beowulf clustering. I was able to do this with 10 hacked xbox's and had great luck with it.
__________________

__________________
Modded Raidmax Hyperion Case
MSI Z97M Gaming
4770K
16gigs Corsair Vengeance 1866mhz
SLI GTX 980s
Samsung 830 Series 128gig SSD
EVGA G2 850W power supply
2x Alphacool ST30 240mm, 1x Alphacool ST30 120mm, swiftech Micro res, Enzotech Rev A. CPU water block, Full Coverage EKWB GPU blocks, modded Vari MCP655 pump
LG 34UM95 21:9 Ultrawide 3440x1440 monitor
Sean W. is offline  
Old 03-05-2012, 05:56 PM   #3 (permalink)
Newb Techie
 
Join Date: Feb 2012
Posts: 36
Default Re: cluster computing

Quote:
Originally Posted by Sean W. View Post
This is definitly possible get your favorite linux flavor and bring up the "man Pages" on beowulf clustering. I was able to do this with 10 hacked xbox's and had great luck with it.
Great, so my question now is, java and android developmemt: it works with a computer cluster? Cause in a cluster a command is broken into pieces to be worked out by different nodes, will that work with java development?
Thanks
xK1LLSW1TCHx127 is offline  
Old 03-06-2012, 09:24 AM   #4 (permalink)
OCZ SSD Enthusiast
 
Night Fox's Avatar
 
Join Date: Dec 2009
Location: Michigan
Posts: 656
Default Re: cluster computing

http://www.proxmox.com/products/proxmox-ve <--ran into this a week ago, might suit your needs.


Edit: from what I've seen, the web-based manager uses java and vnc through the browser to view the desktop. It's a very simple setup: Install proxmox on each computer, make one the master, make the others the nodes, and then create the virtual machine. They even have pre-built virtual machines that you can download and install directly (or you can upload your own ISO and install that).
__________________
Asus P5Q Motherboard * OC'ed Intel Core2 Quad Q9400 2.82ghz w/ Arctic Silver 5 * OCZ Platinum 4GB (2 x 2GB) DDR2 1066ghz * Kingston Hyper X (2x2gb) DDR2 1066ghz * EVGA GTX 560 Ti Superclocked * Ultra X-Blaster ATX Mid-Tower * OCZ Vertex 2 120gb * WD Caviar Blue 500GB 7200 rpm * OCZ ModXStream Pro 700W Modular PSU * Sony Optaric DVD Burner * Windows 7 Home Premium 64-bit * 22" LG Flatron W2252TQ LCD * LG Flatron E2281

Samsung Series 7 17.3" Laptop w/ 256gb Vertex 4 SSD
Night Fox is offline  
Old 03-06-2012, 12:11 PM   #5 (permalink)
The Residential Loon
 
Spud1200's Avatar
 
Join Date: Nov 2010
Location: England, UK
Posts: 2,088
Default Re: cluster computing

I had no Idea this was possible and you could Cluster Computers, makes sence now that I think about it, but haveing 4 Systems here at Home I wounder if a Cluster would benifit me in way F@H with a Linux Distro even for just the two Desktops I have. Only problem is I have never had and got no experience with Linux so the likes of the Drivers for the System and likes of the Devices ect I wouldnt have a clue were to start.

Thanks for that, gonna look up and do some reading on the subject.
Spud1200 is offline  
Old 03-06-2012, 09:02 PM   #6 (permalink)
Newb Techie
 
Join Date: Feb 2012
Posts: 36
Default Re: cluster computing

Quote:
Originally Posted by Night Fox View Post
Proxmox - Proxmox VE <--ran into this a week ago, might suit your needs.


Edit: from what I've seen, the web-based manager uses java and vnc through the browser to view the desktop. It's a very simple setup: Install proxmox on each computer, make one the master, make the others the nodes, and then create the virtual machine. They even have pre-built virtual machines that you can download and install directly (or you can upload your own ISO and install that).
Ok, so what I'm getting from this is that i can set up my cluster and then after I install linux on each slave and the master I can run a Kernel Virtual Machine (proxmox) on each node and the master, and have the entire cluster run a Linux distro as a Virtual Machine, allowing me to install the SDK, Eclipse, and JDK I need to develop for Android? Am i understanding correctly? Because if i am, than that is pretty Epic =)

By the way, thank you all for responding so quickly, this thread is being extremely helpful to me =)
xK1LLSW1TCHx127 is offline  
Old 03-06-2012, 09:09 PM   #7 (permalink)
OCZ SSD Enthusiast
 
Night Fox's Avatar
 
Join Date: Dec 2009
Location: Michigan
Posts: 656
Default Re: cluster computing

No. Proxmox is the operating system you install on each computer (so the Proxmox OS is running by itself). You set one computer to be the master, and the rest of them nodes. Then you create a virtual machine through the web-based manager which controls everything, and install your OS of choice on the virtual machine. Then you can connect to that virtual machine from a different computer remotely, and you have everything.

Now, you may an issue with this, as the cluster will be fast, but I'm not so sure how well the remote connection (vnc) will work for you. Couldn't hurt to give it a shot. This guy I work with is testing this out on a couple of servers, so I can take a look around when I get time and see if it works reasonably well for programming in vnc connection.
__________________
Asus P5Q Motherboard * OC'ed Intel Core2 Quad Q9400 2.82ghz w/ Arctic Silver 5 * OCZ Platinum 4GB (2 x 2GB) DDR2 1066ghz * Kingston Hyper X (2x2gb) DDR2 1066ghz * EVGA GTX 560 Ti Superclocked * Ultra X-Blaster ATX Mid-Tower * OCZ Vertex 2 120gb * WD Caviar Blue 500GB 7200 rpm * OCZ ModXStream Pro 700W Modular PSU * Sony Optaric DVD Burner * Windows 7 Home Premium 64-bit * 22" LG Flatron W2252TQ LCD * LG Flatron E2281

Samsung Series 7 17.3" Laptop w/ 256gb Vertex 4 SSD
Night Fox is offline  
Old 03-06-2012, 11:43 PM   #8 (permalink)
Newb Techie
 
Join Date: Feb 2012
Posts: 36
Smile Re: cluster computing

Ok, i see. Now my only worry is that JDK, SDK and Eclipse are not designed to be split into a cluster to be run like that, right? I can build the cluster, I read up on the software and i can do that, the problem is will my cluster run the SDK, JDK and Eclipse as a single machine for me, or will my Master PC run the software while all of the nodes are simply sitting there sucking up electricity? I hope my question is clear, thanks again guys!
xK1LLSW1TCHx127 is offline  
Old 03-07-2012, 07:49 AM   #9 (permalink)
OCZ SSD Enthusiast
 
Night Fox's Avatar
 
Join Date: Dec 2009
Location: Michigan
Posts: 656
Default Re: cluster computing

From what I've read, the actual virtual machine is stored on the hard drive of one of the machines (either the master or one of the nodes), then the resources of all machines are combined for the virtual machine's use. Therefore, everything you install will not even realize there is a cluster, it will look just like a regular OS (unless it can differentiate between a virtual OS and a real OS). What I was saying in my previous post is that the only way to see the desktop of the virtual machine, is to remotely connect to it with vnc or other program, which may be slow.
__________________
Asus P5Q Motherboard * OC'ed Intel Core2 Quad Q9400 2.82ghz w/ Arctic Silver 5 * OCZ Platinum 4GB (2 x 2GB) DDR2 1066ghz * Kingston Hyper X (2x2gb) DDR2 1066ghz * EVGA GTX 560 Ti Superclocked * Ultra X-Blaster ATX Mid-Tower * OCZ Vertex 2 120gb * WD Caviar Blue 500GB 7200 rpm * OCZ ModXStream Pro 700W Modular PSU * Sony Optaric DVD Burner * Windows 7 Home Premium 64-bit * 22" LG Flatron W2252TQ LCD * LG Flatron E2281

Samsung Series 7 17.3" Laptop w/ 256gb Vertex 4 SSD
Night Fox is offline  
Old 03-07-2012, 08:37 PM   #10 (permalink)
OCZ SSD Enthusiast
 
Night Fox's Avatar
 
Join Date: Dec 2009
Location: Michigan
Posts: 656
Default Re: cluster computing

Quote:
Originally Posted by AldenFR0 View Post
The problem is that it appears that every form of computer cluster is mainly for scientific purposes.
Proxmox is built for virtual servers. Not scientific, yet, not exactly programming, but it may work for killswitch.
__________________

__________________
Asus P5Q Motherboard * OC'ed Intel Core2 Quad Q9400 2.82ghz w/ Arctic Silver 5 * OCZ Platinum 4GB (2 x 2GB) DDR2 1066ghz * Kingston Hyper X (2x2gb) DDR2 1066ghz * EVGA GTX 560 Ti Superclocked * Ultra X-Blaster ATX Mid-Tower * OCZ Vertex 2 120gb * WD Caviar Blue 500GB 7200 rpm * OCZ ModXStream Pro 700W Modular PSU * Sony Optaric DVD Burner * Windows 7 Home Premium 64-bit * 22" LG Flatron W2252TQ LCD * LG Flatron E2281

Samsung Series 7 17.3" Laptop w/ 256gb Vertex 4 SSD
Night Fox is offline  
Closed Thread

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Cluster Computing Processors mad_engr New Systems | Building and Buying 3 10-29-2009 04:41 AM
XP cluster roisen.dubh Microsoft Windows and Software 7 08-07-2006 12:38 PM
What Cluster Size? lazerman Monitors, Printers and Peripherals 4 01-22-2005 08:35 PM
Beowulf Cluster mnms238 Linux and Open Source 2 12-23-2004 11:35 AM
Windows xp cluster? Nissanspecv04 Microsoft Windows and Software 4 12-15-2004 08:23 PM



Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -5. The time now is 01:28 AM.


Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.