April 18, 2013 | Kevin Meinert
The Dev Team isn’t the only department that gets to have fun. Last month we had our own retreat that was a blast. Here is how it went down.
Sunday, March 3rd
First arrival! We checked in, got our things together, and prepped for an early start on Monday.
Monday, March 4th
We kicked it off at 9am, laying down the house rules. On the tech side, we deployed Data Dog (our new monitoring tool), setup server scripts, and monitored key endpoints (provisioning scripts, HTTP load, status codes). We configured the NOC monitoring dashboards with more granular data for better reporting, and moved our Edge08 customers to new hardware (and PoPs). Lunch was a meat inception: bacon-wrapped hot dogs! We took time to enjoy the day with volley/bocce ball.
Tuesday, March 5th
Tuesday involved a lot of testing. We setup the dashboard for all switch network traffic, for a full network traffic diagram. Next, we tested our new DNS service for our non-Anycast locations. We made sure our DNS failover system worked (to avoid catastrophic outages), and configured our Australian servers (a new PoP) for performance testing. Similar to the day before, we moved our Edge06 customers to new hardware, and finalized our Dallas colocation rack move. After the work was done, we went for dinner and drinks. Kareem and Fred won free beer with some precision basketball shots into a mini hoop. Nice job! We finished up with some great games of FIFA.
Wednesday, March 6th
Last day. We de-commissioned some old hardware, but left a few servers around as additional testing clusters. We planned the new status page and proactive notification service from NOC for maintenance and status updates. Later on, we migrated our Edge02 customers to new hardware and PoPs (San Francisco and London). Lastly, we planned the colocation, hardware, and network configuration for our Frankfurt deployment.
You can’t beat this lunch outing: burgers and BBQ on the beach! We had a great time and are planning our next retreat… Maybe you can join us?