Incidents | UpTrader Incidents reported on status page for UpTrader https://status.uptrader.io/ https://d1lppblt9t2x15.cloudfront.net/logos/321077b9dedc1ce39669c1f61ed8cbb5.png Incidents | UpTrader https://status.uptrader.io/ en UpTrader CRM recovered https://status.uptrader.io/ Wed, 25 Mar 2026 04:08:35 +0000 https://status.uptrader.io/#69a5b41c9cbb8ee5e3afa18876ea0a92b54fee8d8f75be232629281df5dffb48 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 25 Mar 2026 03:58:53 +0000 https://status.uptrader.io/#69a5b41c9cbb8ee5e3afa18876ea0a92b54fee8d8f75be232629281df5dffb48 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 25 Mar 2026 03:06:58 +0000 https://status.uptrader.io/#5b9a1a98fe1c74999d76b983b872b21551be45dd1f618ead4b1f4d1dcdf0cd2a UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 25 Mar 2026 03:01:37 +0000 https://status.uptrader.io/#5b9a1a98fe1c74999d76b983b872b21551be45dd1f618ead4b1f4d1dcdf0cd2a UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 15:43:37 +0000 https://status.uptrader.io/#649bfdd26d244bf86cfed244aabcb2a77e40dc8b08cfaae5ce9ed6481f395bc0 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sun, 22 Mar 2026 15:27:31 +0000 https://status.uptrader.io/#649bfdd26d244bf86cfed244aabcb2a77e40dc8b08cfaae5ce9ed6481f395bc0 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 15:18:06 +0000 https://status.uptrader.io/#8d02ab756666ba8c1e7b62436cd580241568f8f2a22749ef89d332aa19940154 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sun, 22 Mar 2026 15:14:31 +0000 https://status.uptrader.io/#8d02ab756666ba8c1e7b62436cd580241568f8f2a22749ef89d332aa19940154 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 13:17:29 +0000 https://status.uptrader.io/#a573694a725464e99ff188013de91297fc6f7e6f63dad9f7498f0bf12cf6afe1 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sun, 22 Mar 2026 13:16:00 +0000 https://status.uptrader.io/#a573694a725464e99ff188013de91297fc6f7e6f63dad9f7498f0bf12cf6afe1 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 13:07:05 +0000 https://status.uptrader.io/#56c97b484d6bca584c121460345dba83ade060db3352d87616eb5d5e04e0111f UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sun, 22 Mar 2026 12:38:47 +0000 https://status.uptrader.io/#56c97b484d6bca584c121460345dba83ade060db3352d87616eb5d5e04e0111f UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 11:42:36 +0000 https://status.uptrader.io/#fcf42e4961a5edbe33a3776e15b46f6755a13b58e4ea2f6d57013354b3bf80ea UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sun, 22 Mar 2026 11:34:55 +0000 https://status.uptrader.io/#fcf42e4961a5edbe33a3776e15b46f6755a13b58e4ea2f6d57013354b3bf80ea UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 09:07:39 +0000 https://status.uptrader.io/#181262ffe6f3d9a70e368f904046d0a0ee207a69199f40f23a61ac48cfa090e4 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sun, 22 Mar 2026 08:03:00 +0000 https://status.uptrader.io/#181262ffe6f3d9a70e368f904046d0a0ee207a69199f40f23a61ac48cfa090e4 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Sun, 22 Mar 2026 03:50:06 +0000 https://status.uptrader.io/#d9d883fcd95da40d94c4788d9c969c7e93022420beb2f98ed451ea3b0e4d26a5 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Sat, 21 Mar 2026 22:27:56 +0000 https://status.uptrader.io/#d9d883fcd95da40d94c4788d9c969c7e93022420beb2f98ed451ea3b0e4d26a5 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 18 Mar 2026 04:49:38 +0000 https://status.uptrader.io/#c106785264071e3e895b9ba092ceb15a200c452208aacf2fb5468b1cb0db08f9 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 18 Mar 2026 04:42:58 +0000 https://status.uptrader.io/#c106785264071e3e895b9ba092ceb15a200c452208aacf2fb5468b1cb0db08f9 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 18 Mar 2026 01:45:01 +0000 https://status.uptrader.io/#293fc93c5d43a963f66808c98357e6cd96c7af42f17781405c512786fa50c49e UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 18 Mar 2026 01:42:55 +0000 https://status.uptrader.io/#293fc93c5d43a963f66808c98357e6cd96c7af42f17781405c512786fa50c49e UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 18 Mar 2026 01:38:59 +0000 https://status.uptrader.io/#56e8f8558a6bfa3bbab9748d94fb62b10162bbb94edcb81b09f86ec0f963aee5 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 18 Mar 2026 01:38:06 +0000 https://status.uptrader.io/#56e8f8558a6bfa3bbab9748d94fb62b10162bbb94edcb81b09f86ec0f963aee5 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 18 Mar 2026 01:25:35 +0000 https://status.uptrader.io/#7659be6e45e473c77d0d0dc2f5abb89855b705c0632174a08ca296f62b9e858b UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 23:32:56 +0000 https://status.uptrader.io/#7659be6e45e473c77d0d0dc2f5abb89855b705c0632174a08ca296f62b9e858b UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 16:58:20 +0000 https://status.uptrader.io/#e47230a67057d5ad799c2de29f42c4e0dcfc57db3c7257b67f02d3a498153961 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 16:57:30 +0000 https://status.uptrader.io/#e47230a67057d5ad799c2de29f42c4e0dcfc57db3c7257b67f02d3a498153961 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 16:13:34 +0000 https://status.uptrader.io/#98b3b4652210fc223ea7186ba464fdcc29899a7943947cc9a9a32e79b0312a9e UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 16:12:52 +0000 https://status.uptrader.io/#98b3b4652210fc223ea7186ba464fdcc29899a7943947cc9a9a32e79b0312a9e UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 16:05:30 +0000 https://status.uptrader.io/#f9780669b674036371a0238a36d9bc8f45c895c902d0589660822c60740b05a6 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 13:30:57 +0000 https://status.uptrader.io/#f9780669b674036371a0238a36d9bc8f45c895c902d0589660822c60740b05a6 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 07:47:38 +0000 https://status.uptrader.io/#e09d45645d860fe1a6a34366b57e3dbbd05107025d407fa757b4430aea6318db UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 07:44:32 +0000 https://status.uptrader.io/#e09d45645d860fe1a6a34366b57e3dbbd05107025d407fa757b4430aea6318db UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 07:41:54 +0000 https://status.uptrader.io/#3143d5d21b237299d5412899f423311a8762395fda5de17a9f6ad14af7a190ec UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 07:40:27 +0000 https://status.uptrader.io/#3143d5d21b237299d5412899f423311a8762395fda5de17a9f6ad14af7a190ec UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 07:31:33 +0000 https://status.uptrader.io/#17914bf7c61368102ffa7f17a0aeec2a39522da26a60c29bbacd024a78307fe2 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 07:29:59 +0000 https://status.uptrader.io/#17914bf7c61368102ffa7f17a0aeec2a39522da26a60c29bbacd024a78307fe2 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 07:20:32 +0000 https://status.uptrader.io/#e83dc6a1ebb6f9177406b23cd9e6d012f4806f5725e3069635cac284979f16c9 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 07:19:55 +0000 https://status.uptrader.io/#e83dc6a1ebb6f9177406b23cd9e6d012f4806f5725e3069635cac284979f16c9 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 17 Mar 2026 07:14:32 +0000 https://status.uptrader.io/#e8e570f116b4d736778209c72b606e2fa0d3e87379eaa5c099e7b21862ebf93f UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 17 Mar 2026 06:36:34 +0000 https://status.uptrader.io/#e8e570f116b4d736778209c72b606e2fa0d3e87379eaa5c099e7b21862ebf93f UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Fri, 06 Mar 2026 01:45:31 +0000 https://status.uptrader.io/#0203c672e9f62d323b56c87fcc1d0d1465b03c555adbb9c23a716179c08de76e UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Fri, 06 Mar 2026 01:37:59 +0000 https://status.uptrader.io/#0203c672e9f62d323b56c87fcc1d0d1465b03c555adbb9c23a716179c08de76e UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 04 Feb 2026 13:24:34 +0000 https://status.uptrader.io/#61b844b1ad1c1a47f199e7f73d15f20c9e6f6d7ab9c65bfbb01f34fc5e3144df UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 04 Feb 2026 13:22:55 +0000 https://status.uptrader.io/#61b844b1ad1c1a47f199e7f73d15f20c9e6f6d7ab9c65bfbb01f34fc5e3144df UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 03 Feb 2026 11:56:34 +0000 https://status.uptrader.io/#9bd1cb75fd1601e658be95f0ebd46a0f8fc18601ec53f4272942ef51f22721bb UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 03 Feb 2026 11:56:03 +0000 https://status.uptrader.io/#9bd1cb75fd1601e658be95f0ebd46a0f8fc18601ec53f4272942ef51f22721bb UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 28 Jan 2026 23:44:01 +0000 https://status.uptrader.io/#96f7110b59874840fa333e1c9d4ac0755860d79aa2acd84256627144a4bfe445 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 28 Jan 2026 23:38:26 +0000 https://status.uptrader.io/#96f7110b59874840fa333e1c9d4ac0755860d79aa2acd84256627144a4bfe445 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Wed, 28 Jan 2026 23:26:03 +0000 https://status.uptrader.io/#4da2e3f16a4c0d502a1352412a77f784c7803660977c52660b547c0ec3d9efa6 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Wed, 28 Jan 2026 23:18:01 +0000 https://status.uptrader.io/#4da2e3f16a4c0d502a1352412a77f784c7803660977c52660b547c0ec3d9efa6 UpTrader CRM went down UpTrader CRM recovered https://status.uptrader.io/ Tue, 06 Jan 2026 19:44:55 +0000 https://status.uptrader.io/#cfc4f89cea746aeaca096680f745ba342680f4f869ab009feab66a7f33d21009 UpTrader CRM recovered UpTrader CRM went down https://status.uptrader.io/ Tue, 06 Jan 2026 19:43:54 +0000 https://status.uptrader.io/#cfc4f89cea746aeaca096680f745ba342680f4f869ab009feab66a7f33d21009 UpTrader CRM went down Incident Report on Extended Downtime of UpTrader CRM System https://status.uptrader.io/incident/464171 Tue, 19 Nov 2024 14:46:00 -0000 https://status.uptrader.io/incident/464171#e9c60a7c4cafab939e904dc0d9f07f188678f08b9f69f85547739d4140e02b1e **Date:** November 19, 2024 * * * **1\. Introduction** This report provides a detailed account of the incidents that led to extended downtimes of our UpTrader CRM system on November 1 and November 19, 2024. These incidents were unprecedented in our seven years of operation, and we are addressing them with utmost seriousness to prevent future occurrences. **2\. Incident Description** **November 1, 2024** - **Time:** At 01:14 UTC, the UpTrader CRM system began experiencing significant performance issues. - **Issue:** A network card on one of our servers started malfunctioning. While it continued to process traffic, it did so at a drastically reduced speed. - **Diagnosis:** The degraded performance made it challenging to promptly identify the root cause. - **Resolution:** Upon determining the issue, the affected server was rebooted, restoring normal operations. - **Downtime Duration:** 2 hours. Analysis revealed that the network card malfunctioned due to processing excessive data without regular reboots. **November 19, 2024** - **Time:** At 10:39 UTC, a similar issue occurred on another server that had not been rebooted since the previous incident. - **Issue:** The network card failed, leading to service disruption. - **Resolution:** The server was rebooted, and the system was restored after 25 minutes of downtime. Following this, we decided to proactively reboot the third and final server to prevent further disruptions. - **Additional Issue:** During the reboot of the third server, a system misconfiguration caused the entire production cluster to go down. - **Resolution:** Multiple issues were identified and resolved. The system was fully operational after 1 hour and 58 minutes of intermittent downtime. **3\. Timeline of Events** - **November 1, 2024** - **01:14 UTC:** Downtime began due to a malfunctioning network card on Server 1. - **03:12 UTC:** Server 1 rebooted; system restored. - **November 19, 2024** - **10:39 UTC:** Network card failure on Server 2 caused service disruption. - **11:04 UTC:** Server 2 rebooted; system restored after 25 minutes. - **11:20 UTC:** Initiated reboot of Server 3. - **11:20 UTC - 13:18 UTC:** System misconfiguration led to intermittent production cluster downtime. - **13:18 UTC:** System restored after resolving multiple issues. **4\. Root Cause Analysis** - **Network Card Malfunctions:** The primary cause was the network cards processing excessive data without regular reboots, leading to performance degradation. - **Delayed Diagnosis:** The servers continued to process traffic slowly, complicating timely identification of the issue. - **System Misconfiguration:** An unforeseen misconfiguration in the system settings caused a complete cluster shutdown during the reboot of the third server. **5\. Impact Assessment** - **Service Downtime:** - **November 1:** 2 hours of system unavailability. - **November 19 (First Incident):** 25 minutes of downtime. - **November 19 (Second Incident):** 1 hour and 58 minutes of intermittent system downtime. - **Business Impact:** Clients experienced interruptions in accessing the UpTrader CRM system, affecting their business operations. **6\. Preventive Measures and Future Actions** To prevent similar incidents, we are implementing the following measures: 1. **Infrastructure Enhancement:** - Increasing the capacity of our production cluster to provide additional resources and redundancy. - Upgrading server  hardware to handle higher loads efficiently. 2. **Proactive Maintenance:** - Introducing scheduled reboots during low-traffic periods. 3. **System Configuration Review:** - Conducting a comprehensive analysis of current system configurations. - Adjusting settings to enhance fault tolerance and prevent misconfigurations. - Establishing protocols for configuration changes and system reboots to ensure stability. **7\. Conclusion** We deeply regret the inconvenience caused by these incidents. Ensuring the reliability and stability of our services is our top priority. We are committed to taking all necessary steps to prevent future occurrences and to maintain the trust our clients have placed in us over the past seven years. **For any further inquiries or assistance, please contact our support team at support@uptrader.io** * * * **Prepared by:** Vasily Alexeev CEO/CTO UpTrader