Multiple routes to external network

I am very close to getting a working Folsom + Quantum, but am having some problems in external network connectivity. I am trying to set up the "Provider Router with Private Networks" case (see http://docs.openstack.org/trunk/openstack-network/admin/content/use_cases_single_router.html). I am also using EmilienM's guide to help me along, though I know there are some differences.

So, here is the issue. I can ping and SSH into the VM, but with lots of issues. First, my SSH connection gets dropped all the time and the VM can not reach back out the external network. No ping no dnslookup.

I think the issue stems from how I have set up my OVS bridges. I think that multiple conflicting routes are being set up. Here is some debug output for reference:

foo@cloud1:~# ip r
10.0.0.0/24 dev eth4 proto kernel scope link src 10.0.0.3
10.5.5.0/24 dev tapdbd89f9a-05 proto kernel scope link src 10.5.5.2
10.5.5.0/24 dev qr-c89b0922-f7 proto kernel scope link src 10.5.5.1
99.59.104.0/23 dev qg-21f69e18-c0 proto kernel scope link src 99.59.105.185
99.59.104.0/23 dev br-ex proto kernel scope link src 99.59.105.184
192.168.49.0/24 dev eth3 proto kernel scope link src 192.168.49.244
192.168.50.0/24 dev eth2 proto kernel scope link src 192.168.50.244

For reference, 99.59.x.x is my public network, 192.168.x.x is my management network, and 10.x.x.x is for VMs.
As far as I can tell these are the following:
      tapdbd89f9a-05 (10.5.5.2) is the DHCP agent
      qr-c89b0922-f7 (10.5.5.1) is the port connecting the tenant network to the provider router
      qg-21f69e18-c0 (99.59.105.185) is the port connecting the provider router to the external network
      br-ex (99.59.105.184) is obviously the port for the br-ex bridge

Following EmilienM's guide I manually add the 99.59.105.184 address to br-ex, otherwise it would not have it. I don't see this step in any other guides.

Also as reference, here is the OVS config:

foo@cloud1:~# ovs-vsctl show
ba000344-9e7f-468d-9eeb-6d455be4938a
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
        Port "tapdbd89f9a-05"
            tag: 1
            Interface "tapdbd89f9a-05"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "qr-c89b0922-f7"
            tag: 1
            Interface "qr-c89b0922-f7"
                type: internal
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
        Port "gre-2"
            Interface "gre-2"
                type: gre
                options: {in_key=flow, out_key=flow, remote_ip="10.0.0.26"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    Bridge br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "eth0"
            Interface "eth0"
        Port "qg-21f69e18-c0"
            Interface "qg-21f69e18-c0"
                type: internal
    ovs_version: "1.4.0+build0"

Any help would be appreciated. I am very sorry I can't be more specific on the issue itself.
Thank you,
   Graham