Differences between revisions 1 and 5 (spanning 4 versions)

BattleMeshV5 Tests

Contents

BattleMeshV5 Tests
1. General Rules
2. Tests

General Rules

routing protocol configuration shall be the same for every test
routing protocols are tested in turn (i.e. not altogether)
cpu and memory consumption will be tracked during each test
no points, just results and a final analysis

Tests

Be Quick or Be Stable Test

To be performed on a subset of the nodes

 +----+
 | L1 |-----(A) : : : : : : (B)
 +----+      :       r1      |
             :               |
             :               |
             : r2            |
             :               |
             :            +----+
            (C)-----------| L2 |
                          +----+

L1, L2: laptops
A, B, C: wireless nodes
link A-B uses association rate r1
link A-C uses association rate r2
r2 > r1
- and | are cables
: are wireless links

Steps

perform a continuous traceroute (mtr or wathever) from L1 to L2
load the network with UDP (iperf or wathever) from L1 to L2
start a 21 minutes download from L2 to L1
see how many times (if any) the route flaps in 21 minutes
see if the routing protocol prefers the slow or the fast route
only 1x for each protocol

Goals

Check the stability of the routing protocol, and if the metric is effective.

References

http://www.youtube.com/watch?v=fZLv2G0Hhn4

The ZooBab Test

To be performed on a subset of the nodes

 +----+
 | L1 |-----(A) : : : : : : (B)
 +----+      :       x       :
             :               :
           x :               : x
             :               :   
             :               :
             :               :
            (C)             (E)       
             |               |        +----+
            (D) : : : : : : (F)-------| L2 |
                     y                +----+

L1, L2: laptops
A, B, C, E: nodes set on channel x
D, F: nodes set on channel y
- and | are cables
: are wireless links

Steps

load the network with TCP (iperf or wathever) from L1 to L2
sleep for 3 minutes
perform a traceroute from L1 to L2 and see if the routing protocol chooses the best route (L1->A->C->D->F->L2)
repeat 3x for each protocol

Goal

See if the routing protocol prefers the channel-changing route, by design or by just because is the best path.

Convergence Time Test

To be performed on the whole mesh

           .~.~.~.~.~.~.~.~.~.~.~.       
    (A) : (                       ) 
         (                         )     
          (                       )
         (           (N)           )
          (                       )
         (                         )     
          (                       ) : (B)
         (        MESH CLOUD       )     
          .~.~.~.~.~.~.~.~.~.~.~.~.

Steps - part 1

traceroute from one end (node A) to the other (node B) of the mesh until the path is stable
find a critical node N in the path so that
1. has good quality links with its neighbors (possibly more than one)
2. if shut down the network does not split
start a ping from A to B
turn off N
count the number of pings from the first lost ping to the first subsequent successful ping
repeat 3x for each protocol

Steps - part 2

start a continuous traceroute (mtr or wathever) from node A to node B
turn back on node N and start a stopwatch
measure the time needed to get the node N (back) into the traceroute

Goal

Just convergence time.

Don't Cross the Streams Test

To be performed on the whole mesh

 +----+            .~.~.~.~.~.~.~.~.~.~.~.            +----+
 | L1 |-----(A) : (                       ) : (C)-----| L3 |
 +----+          (                         )          +----+
                  (                       )
                 (          MESH           )
                  (         CLOUD         )
 +----+          (                         )          +----+
 | L4 |-----(D) : (                       ) : (B)-----| L2 |
 +----+          (                         )          +----+
                  .~.~.~.~.~.~.~.~.~.~.~.~.

L1, L2, L3, L4: laptops
A, B, C, D: edge wireless nodes

Steps

start, at the same time:
1. a TCP stream between L1 to L2
2. a TCP stream between L3 to L4
3. a stopwatch
sleep for 21 minutes
measure the total number of bytes transferred
only 1x for each protocol

Goal

See if the routing protocol can choose the paths for the two streams that maximizes throughput.

References

http://www.youtube.com/watch?v=jyaLZHiJJnE

-  ⇤ ← Revision 1 as of 2012-02-29 22:08:03 → 
  Size: 1220
  Editor: Clauz
  Comment:
+   ← Revision 5 as of 2012-03-01 11:50:42 → ⇥
  Size: 4899
  Editor: Clauz
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 13:
+=== Be Quick or Be Stable Test ===

To be performed on a subset of the nodes

{{{

 +----+
 | L1 |-----(A) : : : : : : (B)
 +----+      :       r1      |
             :               |
             :               |
             : r2            |
             :               |
             :            +----+
            (C)-----------| L2 |
                          +----+
}}}

 * L1, L2: laptops
 * A, B, C: wireless nodes 
 * link A-B uses association rate r1
 * link A-C uses association rate r2
 * r2 > r1
 * - and | are cables
 * : are wireless links 

==== Steps ====
 1. perform a continuous traceroute (mtr or wathever) from L1 to L2
 1. load the network with UDP (iperf or wathever) from L1 to L2
 1. start a 21 minutes download from L2 to L1
 1. see how many times (if any) the route flaps in 21 minutes
 1. see if the routing protocol prefers the slow or the fast route
 1. only 1x for each protocol

==== Goals ====
Check the stability of the routing protocol, and if the metric is effective.

==== References ====
 * http://www.youtube.com/watch?v=fZLv2G0Hhn4
-Line 15:
+Line 56:
+To be performed on a subset of the nodes
-Line 16:
+Line 58:
-=== Be Quick or Be Stable Test ===
+{{{

 +----+
 | L1 |-----(A) : : : : : : (B)
 +----+      :       x       :
             :               :
           x :               : x
             :               :   
             :               :
             :               :
            (C)             (E)       
             |               |        +----+
            (D) : : : : : : (F)-------| L2 |
                     y                +----+
}}}

 * L1, L2: laptops
 * A, B, C, E: nodes set on channel x
 * D, F: nodes set on channel y
 * - and | are cables
 * : are wireless links 

==== Steps ====
 1. load the network with TCP (iperf or wathever) from L1 to L2
 1. sleep for 3 minutes
 1. perform a traceroute from L1 to L2 and see if the routing protocol chooses the best route (L1->A->C->D->F->L2) 
 1. repeat 3x for each protocol

==== Goal ====
See if the routing protocol prefers the channel-changing route, by design or by just because is the best path.
-Line 21:
+Line 92:
-To be performed on the whole mesh and repeated 3x for each protocol
+To be performed on the whole mesh
-Line 23:
+Line 94:
-==== Part 1 ====
+{{{
           .~.~.~.~.~.~.~.~.~.~.~.       
    (A) : (                       ) 
         (                         )     
          (                       )
         (           (N)           )
          (                       )
         (                         )     
          (                       ) : (B)
         (        MESH CLOUD       )     
          .~.~.~.~.~.~.~.~.~.~.~.~.
}}}

==== Steps - part 1 ====
-Line 26:
+Line 110:
-. has good quality links with its neighbors (possibly more than one)
   1. if shut down the network does not split
+   a. has good quality links with its neighbors (possibly more than one)
   a. if shut down the network does not split
-Line 31:
+Line 115:
+. repeat 3x for each protocol
-Line 32:
+Line 117:
-==== Part 2 ====
+==== Steps - part 2 ====
 1. start a continuous traceroute (mtr or wathever) from node ''A'' to node ''B''
 1. turn back on node ''N'' and start a stopwatch
 1. measure the time needed to get the node ''N'' (back) into the traceroute
-Line 34:
+Line 122:
-. start a continuous traceroute (e.g. mtr) from node ''A'' to node ''B''
 1. turn back on node ''N'' and start a stopwatch
 1. measure the time needed to get the node N (back) into the traceroute
+==== Goal ====
Just convergence time.
-Line 40:
+Line 127:
+To be performed on the whole mesh 

{{{

 +----+            .~.~.~.~.~.~.~.~.~.~.~.            +----+
 | L1 |-----(A) : (                       ) : (C)-----| L3 |
 +----+          (                         )          +----+
                  (                       )
                 (          MESH           )
                  (         CLOUD         )
 +----+          (                         )          +----+
 | L4 |-----(D) : (                       ) : (B)-----| L2 |
 +----+          (                         )          +----+
                  .~.~.~.~.~.~.~.~.~.~.~.~.
}}}


 * L1, L2, L3, L4: laptops
 * A, B, C, D: edge wireless nodes 

==== Steps ====
 1. start, at the same time:
   a. a TCP stream between L1 to L2
   a. a TCP stream between L3 to L4
   a. a stopwatch
 1. sleep for 21 minutes
 1. measure the total number of bytes transferred
 1. only 1x for each protocol

==== Goal ====
See if the routing protocol can choose the paths for the two streams that maximizes throughput.

==== References ====
 * http://www.youtube.com/watch?v=jyaLZHiJJnE