I finally have something that I can test to see if it will work.
Some background. I started down the road using LVS. I have some luck if we were going to be using it for internal load balancing only. But as soon as I wanted to have the virtual IP become public and web machines private I ran into issues. Because of the traffic we get using net-masking wasn't an option. I still would have had to solve the HTTPS issue but that was for another day. All my tests failed when I moved to a public-private configuration. I tried a variety of tutorials that I found online but I was unable to find any that either explained it in enough detail that I could alter it to meet my needs or didn't even approach my situation.
Then after waiting a couple of weeks and looking at it again I was doing some additional searching and the end of the day I ran across a program called Pound that seemed promising. But didn't have time to do anything more than read the tutorial. It looked like it would do everything I needed. Now I am a little skeptical that it would work as things rarely work out that well. The next morning I started implementing the solution. I deleted my current virtual machines, they didn't work anyway, and started over. Within a couple of hours I have a first load balancer up and appeared to be working. Then I went looking for a tutorial on implementing fail over with Pound. It recommended keepalive. So I set that up and the second load balancer. Then pointed to a couple of our existing servers and started testing. Internal HTTP first....Success. Internal HTTPS next....Success. External HTTP.....Success. And finally External HTTPS....success. Needless to say I am stoked. All pieces seem to be working properly. Now I need to figure out some bench marking to see what it can handle as well as test the fail over. If they work then wow what a relief it will be to have something working.
Now I need to find the time to actually implement it into production so that the real world can prove how well it will work. Assuming it does will be a great help.
If learn anything new I will post it in another post.