Identified
Updated

Hi,

During the weekend, we have conducting deep-level diagnostics and refactoring service interactions to address ongoing performance issues.

eSigning Functionality: Remains fully operational. Users can continue to sign and seal documents. Query Functionality: API response times have a minor improvement based on the infrastructure changes done on Friday; however, they have not yet reached our expected performance benchmarks, and query-based integrations will be affected by our query API endpoints performance.

What to expect for Monday, March 16th:

  • During the first half of the day, the service is expected to perform within the same parameters observed on Friday, March 13. You may still experience some slowness in query-related tasks.
  • Next steps: We are currently analyzing the service interactions captured over the weekend to finalize a new optimization patch scheduled for Monday.
Avatar for Verified Support
Verified Support
Updated

Our team is continuing to address the platform's performance issues. We are maintaining our focus on the infrastructure and service investigations.

While these remediation efforts are ongoing, we will be monitoring all system metrics closely and we will provide further updates as the situation evolves.

Avatar for Verified Support
Verified Support
Updated

We are continuing our work to address the platform's current performance issues. At this stage, our team is focusing on three main areas:

  • Improving Infrastructure: Increasing the resources available to our core services.
  • Deep-Level Diagnostics: Enhancing monitoring to better analyze service interactions.
  • Targeted Service Reviews: Individually investigating each service to address the exact cause of the issue.

We remain fully committed to restoring the platform to its expected performance levels and will share further information as these steps progress.

Avatar for Verified Support
Verified Support
Updated

Following our monitoring of business-hour traffic, we have determined that while our previous patch provided some stability, it had limited success in fully restoring the expected query API operations performance.

We are currently seeing sub-par performance and latency on the following endpoints:

Company selection page: app.verified.eu/api/companies/

Archive & Search: app.verified.eu/api/query-new/

Our Engineering team is currently working on a new, targeted patch to optimize the affected query responses. "All hands on deck" remains the status of the remediation efforts.

Avatar for Verified Support
Verified Support
Updated

Following the morning deployment, our team is currently focusing on real-time traffic analysis. Our engineering team remains fully dedicated to this incident, fine-tuning the query service and observing the impact of this morning’s optimizations.

Avatar for Verified Support
Verified Support
Updated

Good morning,

Late yesterday evening, our Engineering team successfully deployed a new version of the query service to the production environment. This patch was specifically designed to optimize API query responses and improve overall system responsiveness.

Because the specific performance bottlenecks are most evident during high-volume periods, we are monitoring the system closely as business-hour traffic increases.

We are maintaining high-alert monitoring of all system metrics. We will provide a further update at the latest on 10:30 CET.

Avatar for Verified Support
Verified Support
Updated

Our work on the ongoing performance incident is progressing. We have transitioned to active infrastructure and code-level remediation during the last few hours.

Throughout the day, we have scaled our infrastructure to provide additional resources aimed at adding more system stability.

Our engineering team is currently developing a patch specifically designed to optimize API query responses. This work is "all hands on deck," and we expect the patch to be ready for testing within the upcoming hours.

The system metrics will remain under continuous monitoring throughout the night to ensure the stability of the eSign system's responsiveness.

Avatar for Verified Support
Verified Support
Updated

Investigation is ongoing and several potential optimizations are currently being evaluated and tested. We will provide further updates as soon as possible.

Avatar for Verified Support
Verified Support
Updated

We are making progress in addressing the ongoing performance issues. Our team is currently implementing infrastructure optimizations and is in the process of testing these changes to validate their impact. We will provide further updates as we monitor the results.

Avatar for Verified Support
Verified Support
Identified

We have identified that the recent maintenance measures had a limited impact on performance. Our team is actively working on additional improvements to restore full stability. Thank you for your continued patience!

Avatar for Verified Support
Verified Support
Updated

While overall responsiveness for Verified eSign has improved during the day, you may still notice some slowness or longer loading times, particularly on the company selection screen.

Our engineering team is closely monitoring these metrics throughout the day to ensure essential services remain available.

To fully resolve what's causing the slow performance, we have scheduled additional remediation measures for today, after business hours. These updates are designed to restore the platform to its full speed without interrupting your current workday.

Avatar for Verified Support
Verified Support
Recovering

We have identified the cause of the degraded performance and have applied several configurations to improve the overall system responsiveness.

The system metrics are showing improved performance during the last 10 minutes, and our team will continue monitoring the service during the day.

Avatar for Verified Support
Verified Support
Investigating

The platform is currently responding slower than usual. Our team is investigating the issue and working to resolve it. We will share updates as soon as possible.

Avatar for Verified Support
Verified Support
Began at:

Affected components
  • Verified AML
    • AML Portal 1.5
      • Company Lookup
      • ID-control
      • PDF generation
      • Screening
      • Forms
    • AML NextGen
      • API
      • Forms
      • Data sources
      • PDF generation
  • Verified CLM eSign
    • Verified eSign
      • Web portal
        • Login
        • Archive
        • Envelope Builder
        • Access Management: Users & Companies
        • Checkout
        • Recipient portal