Mississippi Network Diagram and Configuration

Contents

A NuCab named "mississippi" serves DHCP and does NAT for our DSL line. All of the metrix boxes run STP. The whole network is bridged, and in the  10.11.104.0/22  network.

We have MississippiMonitoring with Cacti: http://chevy.personaltelco.net/cacti/graph_view.php

MississippiLoadBalancing: The Ballroom DSL line and the NodeFreshPot line are available, but the FreshPot wireless link has not be very stable lately. We have seen and had a report of pages only half-loading, which is plausibly related to the load-balancing. We've removed the load balancing for the time being to assess its impact on the problem.

News

May 6, 2014: After a couple month outage, NodeEd (4135 N Mississippi), service was restored this evening to the northern most part of the network, thanks to the generous and moderately risky efforts of our volunteer crew: EdHan, GustavSwanson, ConnorScott, JasonBergstrom, JorenLove, RussellSenior, and MatthewKlug. There were scheduling problems around getting people and cooperative weather lined up simultaneously. But tonight, in just a few hours, we pulled it all together. The same Metrix box on the same mast was reinstalled. A new ethernet connector and cat6 cable run into the house was installed, with new chimney straps on a new chimney. Hopefully, will be good for another 8 years. Meanwhile, the Ballroom roof is still having trouble. I was hopeful that tonights reinstallation would provide a path back to the gateway for Ballroom, but since we our aim improved to the desired target (Commons), it got worse for Ballroom. So, the Ballroom roof is still needing some kind of solution. --RussellSenior

December 30, 2013: There was another outage yesterday (until about 9am this morning). A few weeks ago, I had installed a UPS on the wall to try to isolate our gear from any building power issues. This time I replaced the Alix2 and all of the power supplies. The NanoStation2 is on a surge-suppression-only power outlet, the others should have some battery backup, possibly for a long time due to the small load we are placing on them. I also replaced the silly wooden shelf device we had there with a simple board on which the Alix2 is mounted using one of our newly acquired wallmount kits, and the three PoE injectors. They are labelled as well. We'll continue to watch this network for misbehavior. --RussellSenior

December 6, 2013: There was an unexplained outage of silt, the alix2 gateway device, at about 4:30pm. I noticed about two hours later, managed to get into the building and check on it. I attached a serial console, got no response, and rebooted it. Came back up fine. No idea why, which is annoying, since it could happen again. I am going to guess it was a power blip of some kind. The electricity there has lots of motor loads for their HVAC equipment. We lost an alix there this year when it stopped talking to its CF card, maybe also related to power. --RussellSenior

January 31, 2013: Updated the alix2 gateway device to OpenWrt r35318 with linux kernel 3.7.4 and IPv6. Client devices can now take advantage of IPv6 connectivity! --RussellSenior

January 29, 2012: Replaced an access point and eventually (today) a wall-wart power supply, the latter fixing the problem, in the laundryroom at the Mississippi Ballroom building. This was a peculiar case, the access point was probably just fine, but for some reason it was not able to supply enough power to *received* data. It came up fine without apparent errors, it beaconed so that clients could see the network, however it was not possible to associate with it. Replacing the power supply fixed the problem. Thanks to ColinFrey for reporting the problem. --RussellSenior

June 28, 2011: We are seeing packet loss on the point-to-point link between the Ubiquiti PowerStation2's on Mississippi Commons and the Grand Central Baking roof. Both ends report (via the LED indicators) solid signal strength. It isn't clear what is causing the packet loss. There is heavy tree folliage in the path. We (DanRasmussen and RussellSenior) noticed that the mast on Ed Han's roof had slipped a bit. It looks like the upper two courses of bricks have moved. This would be consistent with a sudden change in signal strength that we saw back in February. Ed has been alerted. --RussellSenior

May 30, 2011: After good experience elsewhere, reflashed the 4 remaining metrix boxes with OpenWrt r27000 and batman-adv, replacing the old Metrix Pyramid + WDS configuration we flashed on them in June of 2007. Thanks Metrix Pyramid. Long live Openwrt + batman-adv! :-) --RussellSenior

April 2, 2010: A power-outage induced downtime. Sometime about 1 p.m., a power outage caused the devices at the bakery (including the gateway device) and commons to drop. The devices on the bakery roof recovered, but apparently, as a result of this power interruption, our metrix on the commons roof got stuck. This was particularly bad because it acts as the primary relay point for the roof-to-roof network. This outage was not noticed for several hours, until late evening. I drove over about 11:30 p.m., got into the building and the telephone closet and power-cycled the metrix, after which the network returned to normal function. --RussellSenior

January 28, 2010: Plugged in two new indoor access points in the Mississippi Ballrooom building, one in the laundry room and the other in the retail space downstairs. Both are Linksys WRT54Gv2's with OpenWrt 8.09.2. I have bridged all the ethernet ports together so that it doesn't matter which is plugged in. The ethernet for downstairs is run on two unused pairs left in the light-blue cat5 run down there. This was to solve the problem of people inside the Ballroom building having not such good connections, when a bunch of gear was on their roof and not helping them out so much. I gave the indoor APs unique SSIDs (www.personaltelco.net/street and www.personaltelco.net/laundry) to help out with users figuring out what they are connected to. Both are on channel 6 for the time being. We should do a more comprehensive site survey to maybe optimize channel utilization. --RussellSenior

August 11, 2009: RussellSenior met Shawn from Stephouse today at the Grand Central Baking building and installed a CPE to connect to Stephouse Wireless for an internet connection, replacing the Covad/Stephouse DSL that we've been using since the Mississippi Network launched way back in 2005. The old gateway nucab in the Ballroom building has been unplugged along with the DSL modem. The primary regression is that we no longer have multiple public IPs and that (temporarily, at least) we don't have port forwards set up to reach the network directly (we have to go in through the VPN). The port forwards should be set up soon by Stephouse. Some other cleanup is needed as well. --RussellSenior

August 7, 2009: SaraHonsberger, RussellSenior, TylerBooth, JorenLove and ChristopherChen worked on improving the link to the bakery roof, so that the rest of the network can be served via a new wireless Internet connection through Stephouse. The old DSL is due to go away in the near future. The installation on the bakery roof was completely revamped. With a Ubiquity PowerStation2 (Stephouse) was installed to link through the trees to the Commons, and a Ubiquity NanoStation2 (Russell) was installed to provide local coverage. Our power had been cut off when the tenant downstairs whose HVAC unit we were sponging off of moved out and turned off their electricity, so we moved the power injection inside to the warehouse space near the bottom of the upper ladder. In the near future, Tyler will provide a CPE to connect to their network and we will install an AlixCab to act as a gateway. On the Commons roof, we revitalized the second cat5 run to the roof, installed the proper PoE injector, and installed a PowerStation2 (Stephouse) to link to the bakery roof. With rough aiming, we achieved 4 bars and a pretty solid connection of about 10Mbps. Retired to Amnesia to celebrate. --RussellSenior

November 16, 2008: Visited the house of EricMessersmith and retrieved the Netgear WGT634U there that had been serving as the access point for the repeater there. Eric's roof-mounted omni directional antenna connects to the outdoor 802.11g network by way of a PTP-owned Buffalo WHR-G54S in client mode. The Netgear connects to the Buffalo and provides local access. Upon examination back on the bench, it appears the Netgear was physically and electrically sound, but that (guessing) someone had made the mistake of plugging the ethernet cable into the WAN port (we frequently want to use the LAN ports in cases like this so that they bridge rather than route). I took the opportunity to update the version of OpenWrt flashed on the Netgear, bridged eth0.1, eth0.0 and ath0 together, so that it won't matter which port the ethernet is connected to. Also set up dnsmasq on the Buffalo to hand the Netgear a particular address (192.168.3.2 or 192.168.3.3, depending on which mac address the bridge gets) using /etc/ethers. The Netgear is configured to get an address from DHCP. It is buttoned up and ready to plug back in, hopefully in the next day or two. --RussellSenior

October 22, 2008: Sometime about 2:30 a.m. today the uninterruptible power supply in the laundryroom of the Ballroom Building interrupted itself. When I got here, a little after noon, the SmartUPS600 was not responding to applied permutations. As a result, I temporarily bypassed the UPS and went to find another one. A bit after 2pm, I returned from Office Depot with a replacement, an APC Backup 900. It is now plugged in and working, as far as I can tell. Hopefully, this one will give us years of good service as the previous one did. --RussellSenior

October 17, 2008: At about 8pm this evening, someone disconnected several of the ethernet cables from the switch in the laundryroom of the Ballroom Building, knocking most of the network off the air. I plugged them back in and left a note asking that people please not disturb the network and to please contact me in the event of trouble. Also, that bittorrent and other p2p applications on the network were not appropriate, because they interfere with the ability for others to use the network. When found to be interfering, the party involved will be blocked until we can discuss the situation. --RussellSenior

October 8, 2008: Visited the roof of the Grand Central Baking building to reset the metrix and also to retrieve the unused WiMax CPE and antenna that belongs to StephouseNetworks. Noticed that there is now an avenue for penetrating the roof. We could, if we wished, remove the enclosure for our PoE switch and move it inside near an AC outlet. This could allow us to provide a better access point for indoor coverage as well. We should perhaps suggest that to the building owners. --RussellSenior

March 13, 2008: Replaced the fourth WgtRepeater with a Ruckus DZ today at Moloko Plus. Previously replaced WgtRepeater devices in the last month or so were at Amnesia, Muddy's and a residential location northeast of the Ballroom building. Should be a substantial improvement at Moloko Plus. --RussellSenior

January 31, 2008: Today, we received and I deposited the restitution funds ordered by the Multnomah County Circuit Court in the case of the MissNet vandalism. It was not particularly expected. I had just been wondering if we would ever see a dime of the money, and found the registered letter 2 minutes later in our post office box. --RussellSenior

January 30, 2008: MichaelWeinberg and RussellSenior visited Mississippi Commons to correct a problem with the ethernet run between the rooftop metrix and the wiring closet. We had power just fine but according to graphs, about mid-December the network connectivity to the wiring closet went away. We found that the Soekris board was fine, but we had an issue with the cable run. We eventually tracked the problem back to a mid-run coupling (keystone to tip connection) near the conduit inside the wiring closet. We fixed that up and everything started working again. In the process, we discovered that the access point in Salty's Dog Shop had disappeared. Michael left a note inquiring about that. Also recently we have upgraded two of the wgt repeaters to Ruckus DZ devices, one northeast of the Ballroom and the other in Muddy's Coffee. It is possible that we now have coverage in Mississippi Pizza, though that is unconfirmed at the moment. --RussellSenior

November 10, 2007: On an unexpectedly nice day, RussellSenior, SaraHonsberger and PaulCLeddy got on the GrandCentralBaking roof and fitted our mast there with some guywires to reduce the swaying and swaying-induced "thunking". Hopefully, that will mitigate the noise the tenants downstairs have been experiencing. Should check in with them in a few weeks to confirm. Paul and Russell also climbed on the Commons roof and Paul got briefed on the gear we have there. We also bumped into someone at MississippiPizza that informed us that the BoiseVoice article had run. We hope to: a) get a copy; and b) begin receiving feedback from residents. --RussellSenior

See MississippiNetworkNews for archived news items.

TODO

When applicable, the person that has assumed the task is noted after it (in parentheses).

  • Retrieve WiMax gear from Grand Central Baking roof

  • Write up a proposal for TramelCrowResidential regarding what we'd like to put on their roof.

  • Solve the Commons-to-Bakery link problem somehow. Summer time leaves are killing the signal.
  • Continue investigation of the potential new roof at Beech & Borthwick

  • Follow up on Mississippi Lofts roof
  • Keep alert for potential for more bandwidth, network is saturating on a daily basis.

Hardware

Building

Location

Hostname

IP address

Interface

MAC

Radio

Chan

To

Notes

Ballroom

Laundry Room

naya

10.11.104.1

eth1

00:10:5A:04:1E:09

N/A

64.105.215.242

eth0

00:00:F8:06:C0:37

N/A

chevy

10.11.104.7

eth0

00:C0:4F:05:92:84

N/A

External 64.105.215.243 forward

SW corner

metrix-ballroom

10.11.104.2

eth0

00:00:24:C3:A9:C0

N/A

ath2

00:02:6F:21:EC:AA

wifi0

165

commons-ath3

17 dBi to Commons

ath0

00:02:6F:21:EC:A5

wifi1

1

clients

9 dbi 120deg pointing S

NW corner

cisco-ballroom-nw

10.11.104.3

BVI1

00:0F:34:ED:D8:B0

Dot11Radio0

11

clients

9 dbi 120deg pointing NW

SE corner

cisco-ballroom-se

10.11.104.4

BVI1

00:0F:34:DF:8C:E0

Dot11Radio0

11

clients

9 dbi 120deg pointing E

NodeFreshPot

Back room

liberace

10.11.104.20

eth2

00:20:78:03:ed:66

N/A

10.11.7.193

eth1

00:00:f8:07:63:f5

N/A

192.168.1.254

eth0

00:10:5a:a6:06:98

N/A

NATed to 67.101.8.16

Indoors(ledge behind counter)

edimax-freshpot

10.11.104.16

br

00:0E:2E:3C:4B:88

11

(client)

integrated omni

Commons

SE corner

metrix-commons

10.11.104.5

eth0

00:00:24:C3:A9:A0

N/A

ath3

00:02:6F:21:EC:A9

wifi0

165

ballroom-ath2

8 dBi 802.11a

ath4

west-ath2

ath5

ed-ath3

ath6

bakery-ath2

ath0

00:02:6F:21:E9:49

wifi1

1

clients

7 dBi omni (w/down-tilt)

Dog shop

edimax-commons

10.11.104.15

br

00:0E:2E:3C:4B:7D

1

clients

integrated omni

Cecily's

Chimney

metrix-west

10.11.104.8

eth0

00:00:24:c3:a9:ac

N/A

ath2

00:02:6F:21:EF:ED

wifi0

165

commons-ath4

17 dBi to Commons

ath0

00:02:6F:21:EF:F2

wifi1

1

clients

9 dBi omni

Ed's

Chimney

metrix-ed

10.11.104.9

eth0

00:00:24:C3:E4:1C

N/A

ath3

00:02:6F:21:EF:F0

wifi0

165

commons-ath5

27 dBi to Commons - Polarization Vertical

ath0

00:02:6F:21:EF:F1

wifi1

1

clients

9 dBi omni

Bakery

Roof

metrix-bakery

10.11.104.10

eth0

00:00:24:c3:A9:B4

N/A

ath2

00:02:6F:21:EC:A8

wifi0

165

commons-ath6

27 dBi to Commons

ath0

00:02:6F:21:EC:A6

wifi1

1

clients

9 dBi omni

See ChannelFrequencyChart for reasoning about channels, and channel choices.

Other hardware (not deployed)

metrix-01

Interface

MAC

10.11.104.11

eth0

00:00:24:C3:A9:B8

wifi0

00:02:6F:21:EC:A2

wifi1

00:02:6F:21:EC:A1

metrix-02

Interface

MAC

10.11.104.12

eth0

00:00:24:C3:E4:30

wifi0

00:0B:6B:4C:B8:D5

wifi1

metrix-dje

Interface

MAC

10.11.104.13

eth0

00:00:24:C2:39:D0

wifi0

00:02:6F:20:F7:2B

wifi1

00:02:6F:21:E8:2B

Metrix-bakery is the reassembled parts from what we previously called metrix-naya-nw, which was damaged in the August vandalism incident. Thanks to Bayhouse, Inc for machining the holes for the new enclosure. Metrix-02's second radio is in the care of TroyJaqua. CalebPhillips has borrowed another radio to help diagnose a problem with his node. Metrix-dje does not technically belong to the MGP, and is marginally unsuitable because it uses the net4526 soekris board, rather than the net4826 soekris board. It is listed here to help keep track of what belongs with what.

See MississippiMetrixConfiguration for a method of preparing and updating the software on the metrixes.

MississippiNetworkDiagram (last edited 2009-12-09 14:43:25 by JasonMcArthur)