Network file storage connectivity issues causing scheduled billing files to not be sent Wednesday, October 4th, 2017 23:00:00 EDT


At approximately 11:00 pm ET, the iLab service experienced intermittent connectivity issues with our network filed storage system which may have caused your institutions nightly file processing to be interrupted. This was an extremely rare occurrence as we have two services in place that regularly monitor the health of this important network connection and unfortunately, both services failed last night and we didn’t get a full failure alert until this morning. No data was lost and any billing files that were scheduled to send last night (October 4th to 5th morning) will be sent today (October 5th night to 6th morning) at their scheduled time.

To mitigate this kind of occurrence in the future, we’re looking at implementing a 3rd monitoring service/health check to ensure a more timely resolution on this.