Incidents reported on status page for UpTrader https://status.uptrader.io/ https://d1lppblt9t2x15.cloudfront.net/logos/321077b9dedc1ce39669c1f61ed8cbb5.png https://status.uptrader.io/ en https://status.uptrader.io/ Thu, 04 Dec 2025 05:57:16 +0000 https://status.uptrader.io/#7172fae68995d180de77d9c14a8f10c70cd371236a1a49c77138eedf59a378f4 UpTrader CRM recovered https://status.uptrader.io/ Thu, 04 Dec 2025 05:54:09 +0000 https://status.uptrader.io/#7172fae68995d180de77d9c14a8f10c70cd371236a1a49c77138eedf59a378f4 UpTrader CRM went down https://status.uptrader.io/ Wed, 03 Dec 2025 14:03:43 +0000 https://status.uptrader.io/#a51b1aa810f513e338ef174081a194d946887523bd07c959b5e7acbce37d2f60 UpTrader CRM recovered https://status.uptrader.io/ Wed, 03 Dec 2025 13:46:42 +0000 https://status.uptrader.io/#a51b1aa810f513e338ef174081a194d946887523bd07c959b5e7acbce37d2f60 UpTrader CRM went down https://status.uptrader.io/ Fri, 14 Nov 2025 14:39:16 +0000 https://status.uptrader.io/#ae125353ab53b7ee0e1cc53aa64cfdff9604d46678de1acefee0bb733bb3ac50 UpTrader CRM recovered https://status.uptrader.io/ Fri, 14 Nov 2025 14:38:15 +0000 https://status.uptrader.io/#ae125353ab53b7ee0e1cc53aa64cfdff9604d46678de1acefee0bb733bb3ac50 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 21:41:08 +0000 https://status.uptrader.io/#6f8e2e228ac1c2c96e807b5d3eade3aee401518d202b235d34ed509a57fcc2ae UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 21:39:29 +0000 https://status.uptrader.io/#6f8e2e228ac1c2c96e807b5d3eade3aee401518d202b235d34ed509a57fcc2ae UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 19:26:25 +0000 https://status.uptrader.io/#872d949f90f9054eec46a411e8ae50cf153dd2ebe0f0d9269462b8cf3fec6c07 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 19:25:09 +0000 https://status.uptrader.io/#872d949f90f9054eec46a411e8ae50cf153dd2ebe0f0d9269462b8cf3fec6c07 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 19:07:31 +0000 https://status.uptrader.io/#3f660d9df66874080b3a0d6e57132cc5a549c639c53a37647165f278caea574b UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 19:02:56 +0000 https://status.uptrader.io/#3f660d9df66874080b3a0d6e57132cc5a549c639c53a37647165f278caea574b UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 19:00:49 +0000 https://status.uptrader.io/#6a9a38ba2dd57397440b6d73466b17dc4175066f7c091706bb03c17fd4176ea2 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:58:41 +0000 https://status.uptrader.io/#6a9a38ba2dd57397440b6d73466b17dc4175066f7c091706bb03c17fd4176ea2 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:56:32 +0000 https://status.uptrader.io/#14aaa5d821f71f45e0f714fe085da8815c1aa6969f498944b0da934a53895be2 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:53:38 +0000 https://status.uptrader.io/#14aaa5d821f71f45e0f714fe085da8815c1aa6969f498944b0da934a53895be2 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:51:39 +0000 https://status.uptrader.io/#6f78c8b1b824a4c158bfe2807df6caf61bd4206953f52717e4fec6dee4e3a4ab UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:49:47 +0000 https://status.uptrader.io/#6f78c8b1b824a4c158bfe2807df6caf61bd4206953f52717e4fec6dee4e3a4ab UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:47:48 +0000 https://status.uptrader.io/#fb2f4067fa8431a076a869b5754b01bfd09ac7e4dfeb2cdc348d58add204a638 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:45:49 +0000 https://status.uptrader.io/#fb2f4067fa8431a076a869b5754b01bfd09ac7e4dfeb2cdc348d58add204a638 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:44:08 +0000 https://status.uptrader.io/#5fa5af86e268b7073103133b6864c86ddd6698faa41d905d9ef0bdac23ee631c UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:43:30 +0000 https://status.uptrader.io/#5fa5af86e268b7073103133b6864c86ddd6698faa41d905d9ef0bdac23ee631c UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:40:38 +0000 https://status.uptrader.io/#26d0f1c31f7d352f674d685a987e091149ed64697d431da90c0f1f44f69b32e3 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:39:08 +0000 https://status.uptrader.io/#26d0f1c31f7d352f674d685a987e091149ed64697d431da90c0f1f44f69b32e3 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:27:34 +0000 https://status.uptrader.io/#14b51bb67de2031287705417135985d30efc154e340af45e78ec51f32e8b0126 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:25:09 +0000 https://status.uptrader.io/#14b51bb67de2031287705417135985d30efc154e340af45e78ec51f32e8b0126 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:23:18 +0000 https://status.uptrader.io/#fbbd2f67c839f588916da9401f70fde33f30413b4cf5aac82053dff03262e590 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:21:09 +0000 https://status.uptrader.io/#fbbd2f67c839f588916da9401f70fde33f30413b4cf5aac82053dff03262e590 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:18:10 +0000 https://status.uptrader.io/#115b2eca1391e7419e9ec866ee8d8dad622032bf6592ec2c3bacedabe5ae6a92 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:15:38 +0000 https://status.uptrader.io/#115b2eca1391e7419e9ec866ee8d8dad622032bf6592ec2c3bacedabe5ae6a92 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:13:10 +0000 https://status.uptrader.io/#10c4f354cef6c036294744eb36c30e583885b1241f01ab38117058c960cce4b0 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:12:14 +0000 https://status.uptrader.io/#10c4f354cef6c036294744eb36c30e583885b1241f01ab38117058c960cce4b0 UpTrader CRM went down https://status.uptrader.io/ Wed, 29 Oct 2025 18:09:09 +0000 https://status.uptrader.io/#c45e1d6c78f7475fa1538ca891b729f021d338555e98b2d1f9e5d3d17c1284f5 UpTrader CRM recovered https://status.uptrader.io/ Wed, 29 Oct 2025 18:07:08 +0000 https://status.uptrader.io/#c45e1d6c78f7475fa1538ca891b729f021d338555e98b2d1f9e5d3d17c1284f5 UpTrader CRM went down https://status.uptrader.io/ Mon, 13 Oct 2025 01:44:13 +0000 https://status.uptrader.io/#dac142be7b51303b414478c12ab319c09bf6bae563f8997e6b52855387aa8006 UpTrader CRM recovered https://status.uptrader.io/ Mon, 13 Oct 2025 01:35:49 +0000 https://status.uptrader.io/#dac142be7b51303b414478c12ab319c09bf6bae563f8997e6b52855387aa8006 UpTrader CRM went down https://status.uptrader.io/ Tue, 07 Oct 2025 13:13:34 +0000 https://status.uptrader.io/#1a1d61742b0cdefac9c685b8597baa5780101a4dcb1f886b000960184cb82706 UpTrader CRM recovered https://status.uptrader.io/ Tue, 07 Oct 2025 13:09:39 +0000 https://status.uptrader.io/#1a1d61742b0cdefac9c685b8597baa5780101a4dcb1f886b000960184cb82706 UpTrader CRM went down https://status.uptrader.io/ Wed, 24 Sep 2025 13:58:15 +0000 https://status.uptrader.io/#aa3aecfd500a9bafd8b9ab7ab1cb34a00512cd5b1856b5f77c94cc15f51e8bab UpTrader CRM recovered https://status.uptrader.io/ Wed, 24 Sep 2025 13:57:42 +0000 https://status.uptrader.io/#aa3aecfd500a9bafd8b9ab7ab1cb34a00512cd5b1856b5f77c94cc15f51e8bab UpTrader CRM went down https://status.uptrader.io/incident/464171 Tue, 19 Nov 2024 14:46:00 -0000 https://status.uptrader.io/incident/464171#e9c60a7c4cafab939e904dc0d9f07f188678f08b9f69f85547739d4140e02b1e **Date:** November 19, 2024 * * * **1\. Introduction** This report provides a detailed account of the incidents that led to extended downtimes of our UpTrader CRM system on November 1 and November 19, 2024. These incidents were unprecedented in our seven years of operation, and we are addressing them with utmost seriousness to prevent future occurrences. **2\. Incident Description** **November 1, 2024** - **Time:** At 01:14 UTC, the UpTrader CRM system began experiencing significant performance issues. - **Issue:** A network card on one of our servers started malfunctioning. While it continued to process traffic, it did so at a drastically reduced speed. - **Diagnosis:** The degraded performance made it challenging to promptly identify the root cause. - **Resolution:** Upon determining the issue, the affected server was rebooted, restoring normal operations. - **Downtime Duration:** 2 hours. Analysis revealed that the network card malfunctioned due to processing excessive data without regular reboots. **November 19, 2024** - **Time:** At 10:39 UTC, a similar issue occurred on another server that had not been rebooted since the previous incident. - **Issue:** The network card failed, leading to service disruption. - **Resolution:** The server was rebooted, and the system was restored after 25 minutes of downtime. Following this, we decided to proactively reboot the third and final server to prevent further disruptions. - **Additional Issue:** During the reboot of the third server, a system misconfiguration caused the entire production cluster to go down. - **Resolution:** Multiple issues were identified and resolved. The system was fully operational after 1 hour and 58 minutes of intermittent downtime. **3\. Timeline of Events** - **November 1, 2024** - **01:14 UTC:** Downtime began due to a malfunctioning network card on Server 1. - **03:12 UTC:** Server 1 rebooted; system restored. - **November 19, 2024** - **10:39 UTC:** Network card failure on Server 2 caused service disruption. - **11:04 UTC:** Server 2 rebooted; system restored after 25 minutes. - **11:20 UTC:** Initiated reboot of Server 3. - **11:20 UTC - 13:18 UTC:** System misconfiguration led to intermittent production cluster downtime. - **13:18 UTC:** System restored after resolving multiple issues. **4\. Root Cause Analysis** - **Network Card Malfunctions:** The primary cause was the network cards processing excessive data without regular reboots, leading to performance degradation. - **Delayed Diagnosis:** The servers continued to process traffic slowly, complicating timely identification of the issue. - **System Misconfiguration:** An unforeseen misconfiguration in the system settings caused a complete cluster shutdown during the reboot of the third server. **5\. Impact Assessment** - **Service Downtime:** - **November 1:** 2 hours of system unavailability. - **November 19 (First Incident):** 25 minutes of downtime. - **November 19 (Second Incident):** 1 hour and 58 minutes of intermittent system downtime. - **Business Impact:** Clients experienced interruptions in accessing the UpTrader CRM system, affecting their business operations. **6\. Preventive Measures and Future Actions** To prevent similar incidents, we are implementing the following measures: 1. **Infrastructure Enhancement:** - Increasing the capacity of our production cluster to provide additional resources and redundancy. - Upgrading server  hardware to handle higher loads efficiently. 2. **Proactive Maintenance:** - Introducing scheduled reboots during low-traffic periods. 3. **System Configuration Review:** - Conducting a comprehensive analysis of current system configurations. - Adjusting settings to enhance fault tolerance and prevent misconfigurations. - Establishing protocols for configuration changes and system reboots to ensure stability. **7\. Conclusion** We deeply regret the inconvenience caused by these incidents. Ensuring the reliability and stability of our services is our top priority. We are committed to taking all necessary steps to prevent future occurrences and to maintain the trust our clients have placed in us over the past seven years. **For any further inquiries or assistance, please contact our support team at support@uptrader.io** * * * **Prepared by:** Vasily Alexeev CEO/CTO UpTrader