[SAC] [Hosting] OSL managed host firewall migration - Tue, May 25, 2pm PDT (2100 UTC)

All,

We’re going to be making a global change related to our host firewall (iptable rules) on all of our Chef managed hosts starting on Tuesday, May 25 at 2pm PDT (2100 UTC). If everything goes well, there should be no interruption in service, however since this is a global change that might impact services, I wanted to send this notice out.

We’re planning on disabling our configuration management globally so that we can make this change individually on each system to ensure we don’t have a mass outage. Obviously, this is going to take some time and I don’t expect we’ll finish on Tuesday and will continue with the process on the following day(s) as needed during our normal business hours.

We have done thorough testing (as much as we can) on our end, so I don’t expect any issues, but we like to plan just in case. This change will make iptable rule management much easier for us in the long run and also simplifies some of it.

If you have any questions, please let me know. I will send out an email once we have finished the migration.

Thanks-

···

Lance Albertson

Director
Oregon State University | Open Source Lab

All,

I wanted to send an end of the day update.

We have completed just over 88% of the migration and will stop for the day. We will continue tomorrow in the morning. As it stands now, we aren’t aware of any customer facing issues but please let us know if there are any.

Thanks!

···

Lance Albertson

Director
Oregon State University | Open Source Lab

We are aware of issues connecting to our various OpenStack web consoles which are related to this change. We’ll be pushing a fix out soon. Apologies for the issue.

···

Lance Albertson

Director
Oregon State University | Open Source Lab

This specific issue has been resolved.

···

Lance Albertson

Director
Oregon State University | Open Source Lab

The firewall migration was completed yesterday afternoon PDT time. I believe we have resolved all of the customer facing issues. If there are any remaining issues you believe might be related to this, please send an email to support@osuosl.org.

Thanks-

···

Lance Albertson

Director
Oregon State University | Open Source Lab