We apologize for any inconvenience this may have caused. Our operations team have resolved the issue and all services should be functioning as expected.
If you need additional information, please contact your TAM or support (support@qualys.com or 1-866-801-6161)
Please provide the following information on this community becaue of no response from support team and TAM.
(1) Brief summary of the problem
(2) Root causeof the problem
(3) Workaround
(4) Action Plan and Permanent Measures
Ohayo, Ichikawa-san;
Our apologies for the inconvenience this morning. In short, we experienced a contention issue in one of our core operational databases on the US Shared Platform. This rendered the database completely unresponsive. Working with Oracle Support, we have identified a specific bug causing this contention and there is a patch already available for it, as well as a set of immediate database configuration parameter changes that will help prevent this contention in the future. These changes were already successfully made earlier today. As well, we are currently qualifying the patch in our QA Labs and will schedule a deployment window as soon as we're confident it works according to our specifications.
Additionally, Qualys is committed to continually improving the availability of the service. To this end, we recently completed a comprehensive re-architecture of our scan distribution system, which effectively decouples this critical service. This new Job Distribution or "JobD" system went live in the US in Q3 of last year, and we have successfully migrated a subset of existing subscriptions to the new platform. Those subscriptions were not impacted by this morning's outage, demonstrating the success of the new model. We are currently planning a methodical migration of the remaining subscriptions to the new JobD service in the coming months.
Cheers,
Peter Albert
VP Operations, Qualys
Konnichiwa Peter-san:
Thank you for your reply.
I was wondering if I could explain the plan to improve QualysGuard availability to customers.
Your QSC presentation is older than your comment, so is it possible for you to provide the enhanced document, which includes the methodical migration, plan and actual achievement and improvement plan?
Also, I strongly request Qualys to provide countermeasures and action plan against these repeated service disruptions not only from an engineering perspective but from a management standpoint.
We apologize for any inconvenience this may have caused. Our operations team have resolved the issue and all services should be functioning as expected.
If you need additional information, please contact your TAM or support (support@qualys.com or 1-866-801-6161)