This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
sunyit [2011/07/29 17:21] – [Anthony] afassett | sunyit [2013/02/12 16:08] (current) – Spring 2013 afassett | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | SUNY IT specific information | ||
+ | =====Bits Project===== | ||
+ | [[http:// | ||
+ | <WRAP round box> | ||
+ | ===System(s)=== | ||
+ | ==Packages== | ||
+ | Apache2 | ||
+ | MySQL Client | ||
+ | MySQL Server | ||
+ | PHP 5 | ||
+ | PHP 5 - GD | ||
+ | PHP 5 - MySQL | ||
+ | PHPMyAdmin | ||
+ | ==Servers== | ||
+ | [[http:// | ||
+ | [[http:// | ||
+ | [[http:// | ||
+ | [[http:// | ||
+ | [[http:// | ||
+ | [[http:// | ||
+ | https:// | ||
+ | ==Routers== | ||
+ | [[http:// | ||
+ | http:// | ||
+ | |||
+ | ===Terms=== | ||
+ | [[http:// | ||
+ | ===Notes=== | ||
+ | [[http:// | ||
+ | </ | ||
+ | =====Daily Reports===== | ||
+ | ====Summer of 2012==== | ||
+ | ===5/ | ||
+ | **Minutes reports meeting**\\ | ||
+ | gw reconfg vpn\\ | ||
+ | c107 4pat vm\\ | ||
+ | ccc vm openvpn\\ | ||
+ | hadoop -> mpi3 -> ccc\\ | ||
+ | __questions at the meet__\\ | ||
+ | 1.) does hadoop know how too get local data? yes\\ | ||
+ | 2.)can hadoop data applications be controlled? yes\\ | ||
+ | ===5/ | ||
+ | In the lab today, counting up and lining up machine for cluster. | ||
+ | Router bits-optiplex gx240 | ||
+ | first cluster - 6x dell dimension 4600\\ | ||
+ | second cluster - 8x -optiplex gx240\\ | ||
+ | third cluster - mixed and unready\\ | ||
+ | fourth cluster - 6x dell dimension 4600\\ | ||
+ | ===5/ | ||
+ | Installed OS on machines. | ||
+ | ===5/ | ||
+ | Installed Open Java JDK on all the machines. | ||
+ | ===5/ | ||
+ | Network problem setting the machine dynamically.!\\ | ||
+ | Tried statically setting ip to old ip address(192.168.202.X/ | ||
+ | ===5/ | ||
+ | Still having network problems... Met with joe to solve them, Joe met with Nick earlier that day.\\ | ||
+ | ===5/ | ||
+ | Still having network problems, configured the machine to have hadoop connected to the java directory(used the bitsgw for a template.) | ||
+ | bitsgw has it configured to $HOME=/ | ||
+ | ===5/ | ||
+ | bitsgw was setup to work along in hadoop now need to configure to work with the other machines... looking into configuration\\ | ||
+ | http:// | ||
+ | ===6/ | ||
+ | Network fixed statically, hadoop configurations for NameNode/ | ||
+ | ===6/ | ||
+ | http:// | ||
+ | looking at the machines and ran the following command: egrep -c ' | ||
+ | seems that none of the dells in the lab work for open nebula...\\ | ||
+ | ===6/ | ||
+ | http:// | ||
+ | more support research for opennebula...\\ | ||
+ | next project is setup for pxe server. Want to create a pxe server in order to have nodes for hadoop be created and used on the fly!\\ | ||
+ | ===6/ | ||
+ | http:// | ||
+ | ===7/ | ||
+ | Moved Hadoop master node from BitGW to PC2... all other nodes are moved down one!\\ | ||
+ | ===7/ | ||
+ | Create user NICK on BITSGW, documentation: | ||
+ | Also had a meeting in C221 on Project: | ||
+ | ===7/ | ||
+ | More and revise version of the Bits project documentation! Working more on the network documentation and Reconnecting the VPN connection with corning and sunyit. Had a meeting with Joe Wednesday 7/15/12. Organized Machines and separate the Hadoop machine from bits router. | ||
+ | ===7/ | ||
+ | looking at making a internal network for hadoop machines. | ||
+ | ==research== | ||
+ | http:// | ||
+ | ===7/ | ||
+ | Setup for the machines is complete and vpn is up. The network setup with a intranet. | ||
+ | ===8/ | ||
+ | started working on a custom iso with hadoop already installed. | ||
+ | ==resources== | ||
+ | https:// | ||
+ | ===8/ | ||
+ | Meeting with Joe discussion on how his script with work with my custom iso. | ||
+ | Joe edited the pxe server and did a refresh. | ||
+ | ====Fall 2012 Semester==== | ||
+ | ===9/ | ||
+ | Researched services to accomplish our goal PXE, NETBOOT, NFS server.\\ | ||
+ | Just to make clear what we want is a diskless networking boot of hadoop machines that can be created dynamically. X amount of nodes with a virtual master node and a virtual router w/ vpn setup to other routers. | ||
+ | ==Resources== | ||
+ | http:// | ||
+ | http:// | ||
+ | http:// | ||
+ | http:// | ||
+ | http:// | ||
+ | ===10/ | ||
+ | http:// | ||
+ | http:// | ||
+ | ===11/ | ||
+ | " | ||
+ | | ||
+ | |||
+ | http:// | ||
+ | |||
+ | First testing step would be to set up a local server, put a few users in it, and configure a few clients to authenticate, | ||
+ | |||
+ | When you're ready, I've always been particularly fond of these tutorials: | ||
+ | |||
+ | http:// | ||
+ | http:// | ||
+ | http:// | ||
+ | ===2/ | ||
+ | Have been working with OpenLdap on a local machine and written documentation in google drive. |