Chris Brind
asked this on February 15, 2012 01:32
Hi,
I've been following the instructions here:
http://support.cloudfoundry.com/entries/20407923-single-multi-node-...
My environment is VirtualBox running on Mac. In order to install each node I had two network adapters on each node:
eth0 = internal network with static assigned address
eth1 = bridged network with dhcp
The intention was that I would disable the bridged network adapter on 3 out of the 4 nodes so that I could run a private multi-node cloud on my Mac.
The problem I'm having is that vcap won't start on the MySQL nodes if the bridged network adapter is disabled. Specifically, the log file contains an error which says that "Network is unreachable". I can ping the other nodes no problem, but obviously this VM has no internet connection since its only network adapter is set to internal network. I've attached a screenshot of the output from the VM.
Any ideas?
Thanks in advance.
Comments
Are you using vbox? I've run into the same issue.
For reasons I will not go into, I had to set up my networking the same way eth0 internal network and eth1 using NAT so the chef installation would work. For some reason, when I would start up, the services would try to use the NAT IP to access services.
I tried the installation at home last night where I could set up VMs using bridged networking and I was able to complete the installation, start the services, and successfully deploy the sample application from the support article. I took the VMs to work this morning and installed them on my work laptop, configured an internal network that matched my home network, then flipped all the network adapters to Host only using the network I just created. Again, services started and I was able to install and run a sample test application.
At that point I thought I was good to go so I tried to install a Rails application and got an error that the rest node needed to install a bundle Gem (don't remember version ). So, I added a new network adapter eth1 to my VM, and used NAT to get internet access so the vm could download the proper gem. The app failed to deploy again with the dreaded "network unreachable" error.
I queried the services table in postgresql and found that the url for the redis service was changed to http://10.0.3.15:48896 , 10.0.3.15, which is the ip of the NAT eth1
At this point, I removed the eth1 adapter and rebooted. Now, none of the services on the rest VM will start.
Why is the redis url getting changed ?
Other than a sql update, how can I make the services bind to eth0 and not rebind to eth1.
I have the ability to reproduce the behavior and provided log files. Just tell me which logs you would need. Thanks.
Hi Chris,
Were you able to sort this out? Can I mark this as resolved?
Hi Gary,
I'm still having the problem, is there more information I can provide?
Hi Lewis,
Can you send your config .yml files?
We recommend installing with the chef install. Per instructions here .
If you've used those instructions for the install, your yml files will be located
at ... /cloudfoundry/.deployments/devbox/config
Gary,
Yes, I used the Chef installation you linked. I will need to do a clean install and then I will post the result.
Lou
Gary,
I'm attaching two tarballs. One is from one of mysql nodes that would not start that contains all config files and the log file. The second file is from the rest node and this also contains logs and config files. The rest tarball also contains the output of netstat -l and ifconfig on the rest vm.
eth0 is a host only network with static IPs, and eth1 is set for NAT for internet access. I used NAT instead of bridged (as the OP did) because I cannot bridge VMs on my company network.
All the services on the vcap-rest VM are binding to eth1 only.
Let me know if you need anything else.
Hello,
We are moving discussion related to the Cloud Foundry open source project to a Google Groups mailing list. See the announcement here:
http://support.cloudfoundry.com/entries/21271016-announcement-cloud...
Please post your questions to the new Google Group here:
https://groups.google.com/a/cloudfoundry.org/group/vcap-dev
Thanks!