Incidents | UpTrader Incidents reported on status page for UpTrader https://status.uptrader.io/ https://d1lppblt9t2x15.cloudfront.net/logos/321077b9dedc1ce39669c1f61ed8cbb5.png Incidents | UpTrader https://status.uptrader.io/ en UpTrader CRM recovered https://status.uptrader.io/ Fri, 31 Jul 2026 01:41:54 +0000 https://status.uptrader.io/#f178e946d2c6bb1f461a9bc7976be305d71083c8d78d2b4b5f7d2c430d3c1ff5 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Fri, 31 Jul 2026 01:37:55 +0000 https://status.uptrader.io/#f178e946d2c6bb1f461a9bc7976be305d71083c8d78d2b4b5f7d2c430d3c1ff5 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:47:53 +0000 https://status.uptrader.io/#5232ff25c26bc61cf48ed330f0328a9c845e900952cfc8a65d3b1afe121bf0a7 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:46:22 +0000 https://status.uptrader.io/#5232ff25c26bc61cf48ed330f0328a9c845e900952cfc8a65d3b1afe121bf0a7 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:43:56 +0000 https://status.uptrader.io/#92afa93bb59925e30b59aabe21af90aded22ce053bcfd78a39de79ab7eff57aa UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:42:57 +0000 https://status.uptrader.io/#92afa93bb59925e30b59aabe21af90aded22ce053bcfd78a39de79ab7eff57aa UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:41:21 +0000 https://status.uptrader.io/#fbfece77d532df89f50162ea1b60e80ac9bbb4385e12130ca840dcd09193a934 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:38:53 +0000 https://status.uptrader.io/#fbfece77d532df89f50162ea1b60e80ac9bbb4385e12130ca840dcd09193a934 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:37:00 +0000 https://status.uptrader.io/#65f3210046c625653ac796760046472f79fffb0369c2a43c63e2efc138c5b75e UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:31:53 +0000 https://status.uptrader.io/#65f3210046c625653ac796760046472f79fffb0369c2a43c63e2efc138c5b75e UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:27:43 +0000 https://status.uptrader.io/#7f24c4398a0916437139dd39105a4a5471c126c728156651614f46199f2f4c3e UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:26:25 +0000 https://status.uptrader.io/#7f24c4398a0916437139dd39105a4a5471c126c728156651614f46199f2f4c3e UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:18:29 +0000 https://status.uptrader.io/#fcbc6bfa485b38ff88310142f6679bf6e1c201d45894638dc527416fb69aee41 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:17:19 +0000 https://status.uptrader.io/#fcbc6bfa485b38ff88310142f6679bf6e1c201d45894638dc527416fb69aee41 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:14:29 +0000 https://status.uptrader.io/#8c01c419c3f8bf61b67170e832eb471040adce7fb937a655bf4609716d4dd708 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:13:34 +0000 https://status.uptrader.io/#8c01c419c3f8bf61b67170e832eb471040adce7fb937a655bf4609716d4dd708 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Thu, 30 Jul 2026 14:09:39 +0000 https://status.uptrader.io/#f09f6a334d4b1ae4f923f61a46ffae220f37af083133b9fa4f496dd816d8392f UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Thu, 30 Jul 2026 14:06:33 +0000 https://status.uptrader.io/#f09f6a334d4b1ae4f923f61a46ffae220f37af083133b9fa4f496dd816d8392f UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sat, 20 Jun 2026 09:49:06 +0000 https://status.uptrader.io/#38165e4a493698ed0167b800acfccf704808d54be4b0e0b2983a51070fdf1f95 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sat, 20 Jun 2026 09:37:41 +0000 https://status.uptrader.io/#38165e4a493698ed0167b800acfccf704808d54be4b0e0b2983a51070fdf1f95 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 27 May 2026 14:01:03 +0000 https://status.uptrader.io/#27c07ae0cd1424de768ccba22635c85ac43b594b9b69f7a783bec0048425ac07 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 27 May 2026 14:00:11 +0000 https://status.uptrader.io/#27c07ae0cd1424de768ccba22635c85ac43b594b9b69f7a783bec0048425ac07 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 20 May 2026 20:39:05 +0000 https://status.uptrader.io/#abfde471bcf18be20b75cdecd65eefb03803d07a0f685af9e4f5ae5d13ff69a1 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 20 May 2026 20:38:01 +0000 https://status.uptrader.io/#abfde471bcf18be20b75cdecd65eefb03803d07a0f685af9e4f5ae5d13ff69a1 UpTrader CRM went down Incident Report on Extended Downtime of UpTrader CRM System https://status.uptrader.io/incident/464171 Tue, 19 Nov 2024 14:46:00 -0000 https://status.uptrader.io/incident/464171#e9c60a7c4cafab939e904dc0d9f07f188678f08b9f69f85547739d4140e02b1e **Date:** November 19, 2024 * * * **1\. Introduction** This report provides a detailed account of the incidents that led to extended downtimes of our UpTrader CRM system on November 1 and November 19, 2024. These incidents were unprecedented in our seven years of operation, and we are addressing them with utmost seriousness to prevent future occurrences. **2\. Incident Description** **November 1, 2024** - **Time:** At 01:14 UTC, the UpTrader CRM system began experiencing significant performance issues. - **Issue:** A network card on one of our servers started malfunctioning. While it continued to process traffic, it did so at a drastically reduced speed. - **Diagnosis:** The degraded performance made it challenging to promptly identify the root cause. - **Resolution:** Upon determining the issue, the affected server was rebooted, restoring normal operations. - **Downtime Duration:** 2 hours. Analysis revealed that the network card malfunctioned due to processing excessive data without regular reboots. **November 19, 2024** - **Time:** At 10:39 UTC, a similar issue occurred on another server that had not been rebooted since the previous incident. - **Issue:** The network card failed, leading to service disruption. - **Resolution:** The server was rebooted, and the system was restored after 25 minutes of downtime. Following this, we decided to proactively reboot the third and final server to prevent further disruptions. - **Additional Issue:** During the reboot of the third server, a system misconfiguration caused the entire production cluster to go down. - **Resolution:** Multiple issues were identified and resolved. The system was fully operational after 1 hour and 58 minutes of intermittent downtime. **3\. Timeline of Events** - **November 1, 2024** - **01:14 UTC:** Downtime began due to a malfunctioning network card on Server 1. - **03:12 UTC:** Server 1 rebooted; system restored. - **November 19, 2024** - **10:39 UTC:** Network card failure on Server 2 caused service disruption. - **11:04 UTC:** Server 2 rebooted; system restored after 25 minutes. - **11:20 UTC:** Initiated reboot of Server 3. - **11:20 UTC - 13:18 UTC:** System misconfiguration led to intermittent production cluster downtime. - **13:18 UTC:** System restored after resolving multiple issues. **4\. Root Cause Analysis** - **Network Card Malfunctions:** The primary cause was the network cards processing excessive data without regular reboots, leading to performance degradation. - **Delayed Diagnosis:** The servers continued to process traffic slowly, complicating timely identification of the issue. - **System Misconfiguration:** An unforeseen misconfiguration in the system settings caused a complete cluster shutdown during the reboot of the third server. **5\. Impact Assessment** - **Service Downtime:** - **November 1:** 2 hours of system unavailability. - **November 19 (First Incident):** 25 minutes of downtime. - **November 19 (Second Incident):** 1 hour and 58 minutes of intermittent system downtime. - **Business Impact:** Clients experienced interruptions in accessing the UpTrader CRM system, affecting their business operations. **6\. Preventive Measures and Future Actions** To prevent similar incidents, we are implementing the following measures: 1. **Infrastructure Enhancement:** - Increasing the capacity of our production cluster to provide additional resources and redundancy. - Upgrading server  hardware to handle higher loads efficiently. 2. **Proactive Maintenance:** - Introducing scheduled reboots during low-traffic periods. 3. **System Configuration Review:** - Conducting a comprehensive analysis of current system configurations. - Adjusting settings to enhance fault tolerance and prevent misconfigurations. - Establishing protocols for configuration changes and system reboots to ensure stability. **7\. Conclusion** We deeply regret the inconvenience caused by these incidents. Ensuring the reliability and stability of our services is our top priority. We are committed to taking all necessary steps to prevent future occurrences and to maintain the trust our clients have placed in us over the past seven years. **For any further inquiries or assistance, please contact our support team at support@uptrader.io** * * * **Prepared by:** Vasily Alexeev CEO/CTO UpTrader