Network Status

News & Information

vz-cpt-1 lxc issues (Resolved)

Affecting Server - vz-cpt-1 | Priority - Critical


We had major outages occur randomly on vz-cpt-1 node which contains a few of the big Managed cPanel VPS Servers. As these are managed servers, its our duty to ensure we keep them going as best we can.

We made a decision to quickly setup a new server and migrate the VPS servers off to new server before the server completely goes offline. Seems to be the RAID card killing the disks.

We will replace the raid card in that server at a later stage but our first priority was to move the VPS serves to a new server quickly.

UPDATE -- 

We replaced the disks on the original node but unfortunately it seems to definitely be the RAID card that is at fault as the disks have failed again.

We will be requesting hetzner to replace the RAID card for us if they can urgently on that server but that will incur downtime on that server. Fortunately this will not affect your VPS servers as we have migrated all customers VPS servers that were on that node to a new node in a different cluster.

Note we logged into each server to ensure all services were up and restarted services that were not.

Kindly inform us immediately if you experience any other issues.

Date - 08/12/2018 10:35 - 08/12/2018 16:35

Last Updated - 08/12/2018 17:52

Emergency Maintenance for Plesk Server (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Critical


Outage on server due to disk failure which is being resolved urgently.

We do apologize for any inconvenience caused due to downtime.

Date - 05/12/2018 12:08

Last Updated - 05/12/2018 12:16

Server Outage : Plesk environment (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Critical


We are currently experiencing at outageat our datacentre.

The outage is affecting all Plesk servers. Our systems administrators are investigating and will have services restored momentarily.

Affected services : Websites, email and databases within the Plesk environment.

 

Date - 27/11/2018 08:11

Last Updated - 27/11/2018 08:27

Server Outage : lin08.hkdns.co.za (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We are currently experiencing an outage on one of our Linux servers.

Server : lin08.hkdns.co.za

Affected service : MySQL , this will affect all customer websites that make use of MySQL databases.

Our systems administrators are currently attending to the issue.

Expected downtime : 1 hour

Date - 23/11/2018 08:59

Last Updated - 23/11/2018 09:05

Client Area Outage (Resolved)

Affecting System - | Priority - Critical


Dear Customers

 

We are currently exepriencing techincal difficulties  our client area.

Our system administrator are attending  to the outage.

We will provide  further feedback once the issue has been resolved.

Date - 02/11/2018 11:54 - 02/11/2018 12:08

Last Updated - 02/11/2018 12:01

Network Outage (Resolved)

Affecting Server - vz-cpt-1-ssd | Priority - Critical


We have encountered an outage at our data centre. All services will be restored momentarily

Outage :  Network Outage at Data Centre

Affected Servers :  VPS Servers on node vz-cpt-1-ssd

Maintenance has been completed,we apologize for any downtime caused.

Date - 16/10/2018 07:36 - 17/10/2018 18:01

Last Updated - 18/10/2018 02:59

Scheduled Mantainance (Resolved)

Affecting System - Servers | Priority - High


Please be aware we are performing maintenance on these following servers

winweb01.hkdns.co.za

winmail01.hkdns.co,za

winsql01.hkdns.co.za

wincp01.hkdns.co.za

lin03.hkdns.co.za

lin10.hkdns.co.za

lin09.hkdns.co.za

Time of maintenance  20:00

It will be down for 20 minutes.

 

 

Date - 17/10/2018 20:00 - 29/10/2018 07:52

Last Updated - 17/10/2018 21:08

Network Issue (Resolved)

Affecting Server - vz-cpt-2-ssd | Priority - Critical


We had a network Outage and we had to restart the servers

Date - 12/10/2018 12:50 - 12/10/2018 14:34

Last Updated - 12/10/2018 14:34

Lin07 server outages (Resolved)

Affecting Server - [ZA] lin07 / cPanel | Priority - Critical


We are currently experiencing some outgates on lin07 , it seems to be a faulty disk. We are running a disk check and will replace if needed. 

Date - 04/10/2018 11:48 - 05/10/2018 23:42

Last Updated - 04/10/2018 11:51

Plesk Server Windows Updates (Resolved)

Affecting Server - [ZA] plesk03/ Plesk | Priority - Critical


We are currently doing our 6 month updates on plesk servers. Each server will be rebooted for a minute or two.

 

Date - 20/09/2018 23:51 - 05/10/2018 23:43

Last Updated - 20/09/2018 23:52

VPS servers on vzcpt2 (Resolved)

Affecting Server - vz-cpt-2-ssd | Priority - Critical


We will be rebooting a VPS as we noticed massive packet loss and high load occuring on the server.

We will investigate thereafter once server is up.

Update: we are migrating all VPS clients to SSD servers

Date - 03/09/2018 08:17 - 05/09/2018 15:54

Last Updated - 05/09/2018 15:55

Managed Cpanel VPS - Email High Load (Resolved)

Affecting Server - vz-cpt-1 | Priority - Critical


We've noticed high load occuring on one of our nodes affecting some Managed cPanel VPS servers.

We are attending to the issue and if not resolved by this evening we will be migrating the VPS servers affected to a new server.


-------------------------

Update: 

We have setup a new server and are moving some VPS servers across to it.

Date - 27/06/2018 15:27 - 29/06/2018 17:07

Last Updated - 28/06/2018 05:09

Data Center Outages (Resolved)

Affecting Server - vz-cpt-3-ssd | Priority - Critical


We are currently experiencing outages with our Hetzner Datacenter. Their engineers are currently attending to this issue and should be resolved shortly
We apologize for the inconvenience caused.

Services are back up and running stable.We will continue to monitor for any further issues.

Date - 19/06/2018 22:36

Last Updated - 20/06/2018 06:40

Hetzner Outage Report (Resolved)

Affecting Server - vz-cpt-3-ssd | Priority - Critical



Issue : Loss of connectivity to the Hetzner Data Centre

Cause : The issue was related to BGP Sessions on their edge routers.

Resolution : The edge routers had to rebooted. Hetzner did continue to monitor and the problem was resolved

Date - 18/06/2018 15:25 - 18/06/2018 15:29

Last Updated - 19/06/2018 10:51

Outage - Few Managed cPanel and Unmanaged VPS (Resolved)

Affecting Server - vz-cpt-1 | Priority - Critical


Currently there is a Outage on vz-cpt-1 server hosting some Managed cPanel and Unamanged Linux VPS servers.

The LVM Volume Group seems to be corrupted. We attempted a LVM repair with it not working we also attempted the normal fsck.

We are looking at alternative repair options and will also be using testdisk to see if we can repair the superblocks.

Will report back if we are successfull. If not we will restore the latest backup of 16th/15th of each VM on that server.

-------------

Only 2 VPS servers seem to have been badly affected. The rest are all up and running. 1 of the VPS servers has lost a few days of data and backup also corrupted due to its state. However we ran a repair and it came right up.
The other VPS we've restored the most recent backup.

All other VPS servers should be working as of the state as of the 16th.

We sincerely apologize for the inconvenience. This was an unfortunate issue and seems the host node software may have created the issue on the new kernel when using Thin Pool feature on LVM Groups.

Date - 17/06/2018 01:32 - 17/06/2018 18:22

Last Updated - 17/06/2018 19:28

Maintenance (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - High


 
Our systems administrators are scheduled to perform maintenance on one of our hosts this evening.
 
Affected Services :
 
Plesk-win01 and  Phone system
 
We estimate that the down-time should not exceed 1 hour.

Date - 04/05/2018 22:00 - 08/05/2018 09:35

Last Updated - 08/05/2018 09:35

Investigate a network issue on plesk01 (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Critical


We are currently investigating a network issue on our Plesk01 server. We apologize for the inconvenience this is causing and are working to resolve it as fast as possible.


------------------------------------ Update

We found that the network card is definintely at fault when cpu spikes above 50% on all 24 cores of the server it seems the network card as all packets then do not pass through.

We decided to swop it out with a Intel Card and updated drivers after a reboot and server seems more stable, CPU usage has also dropped below 10% which is where it usually should be.

We will however have to continue monitoring it and added a few extra SNMP sensors and Nagios sensors to the server to monitor more stats. This may cause extra load as we use CACTI and Nagios to monitor many parts of each server.

Nevertheless we are confident the change should work and will keep this status update with any new updates.

----------------------

We came across one of the disks being faulty aswell on this same node. 

This server has been running for 2 years now with no issues but seems we unfortunately will need to rebuild a new server and move the content across. Note we will plan a way in minimizing downtime as best we can and ensure we perform the maintenance and transfers during the evening at around 1am only.

----------------------


Date - 28/04/2018 10:54 - 04/05/2018 10:29

Last Updated - 29/04/2018 21:33

Outage in Data Center affecting a few servers (Resolved)

Affecting System - cPanel Servers | Priority - Critical


There is an outage currently in Data center with some of our servers. We are curretnly investigating.

The following servers have been picked up as currently affected:

lin02
lin08
lin01
lin04

We will try and get them up as soon as possible.

-------------------

Issue seems to be disks attached to RAID become faulty at the same time. 1 SSD and 1 Enterprise SATA disk failed.

We have replaced the disks and it may require rebuilding this evening but servers should be up and running already.

We apologize for any inconvenience caused.

Date - 25/04/2018 22:56 - 26/04/2018 07:49

Last Updated - 26/04/2018 00:12

Netork Server Outages (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We are currently resolving issues with our servers.
We apologize for the inconvenience during the downtime.
We will update you the moment the issue has been resolved.
The issue has been resolved,services should resume as normal within next few minutes.

Date - 19/04/2018 11:06

Last Updated - 19/04/2018 11:14

Lin03 Server Outage (Resolved)

Affecting Server - [ZA] lin03 / cPanel | Priority - Critical


We are currently experiencing issues with litespeed/apache on  lin03 which we are currently attending to,sorry for the inconvenience caused.

We have resolved the issue,we will continue to further monitor for any problems.

Date - 28/03/2018 09:21

Last Updated - 28/03/2018 09:38

Intermitent Connection Data-Centre (Resolved)

Affecting System - | Priority - Medium


We are seeing some intermittend connection issues at our Johannesburg Data-Centre.
Technicians are working on the issue and we should have it sorted soon,

Date - 28/02/2018 17:28 - 28/02/2018 18:32

Last Updated - 28/02/2018 17:29

Live Chat maintenance (Resolved)

Affecting System - Live chat system under maintenance | Priority - Critical


Hi, 

We are currently performing maintenance on our chat service. Please feel fry to contact us via email or contact our call centre

Date - 26/02/2018 14:37 - 26/02/2018 15:39

Last Updated - 26/02/2018 14:40

Reboot of VZ-CPT-1 VPS node (Resolved)

Affecting Server - manage.hkdns.co.za | Priority - Medium


We will be rebooting the node VZ-CPT-1 that hosts some of our VPS's tonite at 22:00 in luei of the outage earlier.

Hostking team

-edit (UPDATE)
Outage has been resolved we did not have to reboot the node VZ-CPT-1.

Thank you.
-edit

Date - 23/01/2018 22:00 - 23/01/2018 22:05

Last Updated - 23/01/2018 23:43

Outtage : VPS's - certain IP ranges (Resolved)

Affecting Server - manage.hkdns.co.za | Priority - Critical


There seemed to be an outage occurrence in data center affecting some openvz VPS servers on certain IP ranges.
We requested the DC technician take a look and noticed it came up on monitoring.
We are still investigating the cause to the issue.

hostking team

-edit
It seems one of the VPS servers on the server received a ddos and hence server network was affected. All should be fine now as we throttled the VPS network and are continuing to monitor it.
-edit

Date - 23/01/2018 18:39 - 23/01/2018 19:17

Last Updated - 23/01/2018 19:09

lin04 Issues (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - Critical


We have received reports aswell as intermittent issues of lin04 cpanel server having issues

We noticed mysql service crashing regularly. Our system admins have rebuilt mysql and added more memory but it is still occuring.
We are attending to the issue and we suspect one of the shared sites causing the issue. Once we find it we will inform the customer or possibly suspend the site temporarily till resolved.

Issue has been resolved.
We informed the client and they resolved the issue in their database.

Date - 19/12/2017 16:47

Last Updated - 19/12/2017 20:30

Maintenance on Hostking Website (Resolved)

Affecting System - Hostking.co.za | Priority - Medium


We are performing some maintenance on our website. Please bare with us while we complete this.

We are optimizing our MySQL DB aswell as PHP limits on our website to increase responsiveness of the site.

Date - 16/12/2017 21:40 - 16/12/2017 23:22

Last Updated - 16/12/2017 21:41

Plesk servers - Reboot (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Critical


We will be rebooting our Plesk - Windows hosting shared servers after emergency maintance. Raid failure on Plesk storage.
Card has been replaced.

Services will be down for a few minutes.

Date - 21/11/2017 11:00 - 21/11/2017 00:00

Last Updated - 21/11/2017 11:03

Intermittent network issue (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We experienced a intermittent network connectivity at our data centre for about an half an hour this issue has since been resolved and services is up and running now.

Date - 13/11/2017 09:21 - 18/11/2017 22:46

Last Updated - 13/11/2017 09:25

Emergency server Outage (Resolved)

Affecting Server - | Priority - Critical


The network outage which was at our cape town data center has been resolved.
Servers are now backup and running.We appologise for the inconveinece caused.We are currently monitoring them.

Date - 01/11/2017 12:45 - 18/11/2017 22:46

Last Updated - 01/11/2017 14:14

lin01.hkdns.co.za temp Issue (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Medium


There is an issue on lin01.hkdns.co.za
Some users might be experiencing temporary connection issues.
Our engineers are working on the issue and should have irt restored shortly.

Date - 30/10/2017 20:18 - 30/10/2017 20:22

Last Updated - 30/10/2017 20:22

Plesk outage (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Low


There is a currently an issue with the RAID on plesk01. We are attending to the issue. Mail should still be fine.

Please bare with us while we attend to the issue.



----------------------

The issue was resolved. We had 2 disks in the RAID fail at the same which affect IIS sites, mail, databases were not affected. This unfortunately caused some delay in restoring site data and rebuilding the RAID array.

All services should be up and running once more. 


------------------------------------

We are continuing to monitor the situation further.

------------------------------------

Unfortunately some data for the 3rd could not be retrievable. We apologize for any inconvenience caused for any sites added on that day. However please contact our support team who will still attempt to see if they can retrieve any data from the backups. Please note as per our terms though our backups are done daily in the evening. So any data during the day between working hours, on or before the crash for a few hours may be unretrievable.

Date - 03/10/2017 21:08 - 04/10/2017 21:32

Last Updated - 04/10/2017 18:52

VPS Servers (Resolved)

Affecting Server - | Priority - Medium


We received reports of services dying on some VPS servers. We had to quickly reboot the box to get services running again.

It seems the issue is related to kernel update causing the issue early this morning.

Issue should be resolved now.

Kindly inform us if there are any further issues.

Note: We are planning on moving all servers on the VPS node to Faster SSD servers this coming weekend. Please stay tuned for that update.

Date - 27/09/2017 17:40 - 28/09/2017 14:19

Last Updated - 27/09/2017 17:42

ZACR Registry System - New Domains / Renewals (Resolved)

Affecting System - ZA Registry of Domains | Priority - Critical


We have had reports from Support Team that domains cannot be registered currentlly. We have investigated and find that the ZA registry currently has issues on their system.

We are awaiting feedback to our latest ticket with them to resolve this issue urgently.

We will provide feedback once received.

Date - 25/09/2017 19:47 - 26/09/2017 00:52

Last Updated - 25/09/2017 20:58

12 - 15 min outage on few servers in JHB DC (Resolved)

Affecting Other - LIN01,LIN03,LIN07,LIN06,LIN05 | Priority - Critical


There was a outage in one of the cabinets affecting a few of our cPanel Shared hosting servers.

Outage lasted 12 - 15 mins. 

Issue has been resolved.

Kindly accept our apologies and we will continue to monitor.

Date - 03/09/2017 00:43 - 03/09/2017 00:44

Last Updated - 03/09/2017 00:44

CPanel update on lin01 causing random account (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


It seems we have encountered a issue with lin01 after a cpanel update it seems to suspend all the domains on that server we have logged a ticket with cpanel themselves and they are investigating this issue

We created a priority ticket with cPanel as the issue seemed to occur during the auto update of cpanel software.

They have responded to us with the following response:

"Thanks for holding, it appears this is a known issue in internal case #CPANEL-15431, in which, a empty line in /etc/passwd is causing this to occur.

I've removed the line and confirmed suspending and unsuspending affected accounts allows the site to load, though there are a large number of already suspended accounts, and accounts that would need this applied.

We should be able to create a loop to suspend and un-suspend just the accounts that are not currently suspended, would it be OK to proceed with this at this time."

-------------------------------------

They are now attempting to implement a temporary fix onto the server.


-----------------------------------------


cPanel have corrected the issue and have stated if the site has been viewed please ensure you clear your browsers cache, close browser and retry as all websites are back online. We can confirm this as we tested over many random sites and all are working. We will however continue to monitor the server going forward.



Date - 23/08/2017 21:04 - 24/08/2017 08:43

Last Updated - 23/08/2017 23:44

Plesk Server Outage (Resolved)

Affecting Server - [ZA] plesk02/ Plesk | Priority - Critical


We had a network outage this morning for 20 minutes for Plesk01 Server in the Cape Town DC. We are attending to the issue.
We have added a temporary fix for now and traffic is working once again.

Please bare with us while we attend to this issue.

---------------------------------------------------------------

Update: We noticed after making some tweaks on the network aswell as the rebooting the network drivers on each server we found server to be more stable.
We are continuing to monitor the servers and will be performing additional stress/load testing this even aswell as creating a fake ddos attack to see how the server handles the load and traffic.

All in all seems server is more stable and we will continue to monitor it going forward.

--------------

We monitored it for the weekend and all ran fine. We will continue to do so and keep you updated if anything else changes.

Date - 18/08/2017 11:03 - 19/08/2017 08:54

Last Updated - 21/08/2017 08:55

Outage in JHB affecting a few servers (Resolved)

Affecting Server - [ZA] lin07 / cPanel | Priority - Critical


There is currently an outage affecting JHB services. We are attending to the issue and will revert back once resolved. Seems to be affecting, lin06, winmail01, lin05 and lin07 thus far.


Update:
A faulty disk in RAID 10 was replaced to resolve the issue. It is currently rebuilding but all should be working nevertheless.

Date - 27/05/2017 22:10 - 27/05/2017 22:23

Last Updated - 27/05/2017 22:24

lin04 apache outage (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - High


There was a 13 minute outage with LiteSpeed/Apache on lin04.hkdns.co.za this evening.

We restarted apache which seemed to resolve the issue

We apologize for any inconvenience caused.

Date - 25/05/2017 23:29 - 25/05/2017 23:42

Last Updated - 25/05/2017 23:50

Unmanaged VPS Server Changes (Resolved)

Affecting Server - | Priority - Low


Please be aware certain changes has been implemented for VPS Servers as currently Proxmox interface does not work. The developers are attending to this.

Additional IP address will need ot be requested through support.
Backups and Restores will also need to be done via support who will escalated to system admin as required. Note there may be a delay in this.
Rebuild feature will have additional templates at a later stage while we update the servers.

Thank you for your patience and time in this regard.


Date - 03/05/2017 10:14 - 25/05/2017 23:50

Last Updated - 04/05/2017 17:37

vz-cpt-1 outage - VPs Servers - Openvz Linux (Resolved)

Affecting Server - | Priority - Critical


There is currently an outage with one of the VPS nodes. We are giving the server a full reboot as we see a kernel panic on the screen.

Should be up shortly.

------

Update: 12:22 - Server came up but went down again. Seems 2 disks in the RAID 10 Array has failed. We are replacing those failed disks and running a fsck at present which may take some time. Raid should but as its RAID 10 should be quite quick.


-----

We have rebooted the server after the fsck and all should be coming up now.

We will however be doing major maintenance this evening at around 1am to correct any possibly issues.


Date - 25/03/2017 12:08 - 25/03/2017 17:28

Last Updated - 27/03/2017 08:29

Plesk server reboot (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Critical


We've noticed some issues on plesk server with respect to email and hence upgrade its to its latest version 9.62 as per Mailenable support who recommended we do so quickly to fix many bugs in their older versions. 

Please give us some time to reboot the server . should take a few minutes.

---------------------

Reboot was completed at around 21:15 however mailenable still ran and repaired itself for another 30 minutes though services were online.

If you experienced any issues we do apologize but all should be back to normal and server is now updated to latest version.

Date - 07/03/2017 21:02 - 07/03/2017 22:29

Last Updated - 07/03/2017 22:29

Plesk-hosting Network issues (Resolved)

Affecting Server - [ZA] plesk01/ Plesk | Priority - Critical


Plesk servers are currently facing a network issue, and we are working to restore the service.


-edit-


All services restored

Date - 07/02/2017 11:49 - 07/02/2017 12:18

Last Updated - 07/02/2017 12:18

Replacing Failed disks in RAID on vz-cpt-1 (Resolved)

Affecting Server - | Priority - Critical


Currently replacing 2 faulty disks in the RAID which are giving issues on one of the Virtual Server Nodes. This may affect a few VPS servers.

Please bare with us while we replace this should not take longer than 15 to 20 minutes.

Date - 25/01/2017 00:11 - 25/01/2017 00:36

Last Updated - 25/01/2017 00:13

LIN02 and LIN04 Server Memory Upgrade (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - High


We have looked at logs of LIN02 and LIN04 and have noticed some sporadic slowness with respect to mysql that may be causing issues for some clients or domains on these servers.

We will be upgrading the server from 12GB of Memory to 16GB this evening and adding more memory to MySQL ofr Innodb purposes.

We will continue to monitor thereafter and also look at increasing this for other servers aswell this coming weekend.

Date - 05/12/2016 00:00 - 05/12/2016 00:05

Last Updated - 06/12/2016 19:57

LIN04 server quick reboot (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - Critical


Hi

We noticed some issue with LiteSpeed on LIN04 occuring where SSL connections were being dropped for a few minutes. We reinstalled litespeed and are monitoring the is situation.
We will reboot the server in next few minutes which should create a few second timeout as we use SSD servers.

We will continue to monitor the server to ensure the issue is resolved and have already reported the issue directly to litespeed.

Date - 29/11/2016 06:42 - 29/11/2016 06:58

Last Updated - 29/11/2016 06:44

Lin05 outage (Resolved)

Affecting Server - [ZA] lin05 / cPanel | Priority - Critical


Their was a outage that occured on lin05 server due to high network usage. We disabled the account causing the issue and everything should be running normally once more. We apologize for any inconvenicence caused.

Date - 18/11/2016 08:46 - 18/11/2016 08:46

Last Updated - 18/11/2016 08:55

Emergency Maintenance vz-cpt-1 Node (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


Emergency maintenance performed on the node.
Server was rebooted to apply new kernel.
Services restored.

Date - 27/10/2016 21:35 - 27/10/2016 21:52

Last Updated - 28/10/2016 07:53

DDOS Attacks being mitigated well (Resolved)

Affecting System - Cpanel Servers | Priority - Critical


We have been receiving very intense DDOS attacks this past week and our system administrators have worked long nights to try and stop this from continuing. We have now tested ratelimiting certain countries which seems to be working. For example Chinese IPs that hit our server to a specific port or from a certain IP to fast will be ratelimited longer than any other country. Most other countries are not ratelimited.

We are continuing to monitor this but as of now all seems to be working well and offending IPs are being blocked on the firewalls as they should be.

Date - 22/09/2016 06:08

Last Updated - 30/09/2016 06:11

LIN02 Email and TLS Forcing Issues (Resolved)

Affecting Server - [ZA] lin02 / cPanel | Priority - Critical


Recently we've noticed that TLS gets forced every evening on this server and hence causing issues when customers try to send emails the next morning. We've hence found a solution and will be implementing it this evening so that this does not reoccur.

We apologize for the inconvenience but rest assured it will be resolved.

------

We completely the reverting to Mailscanner at 6pm. All should be functioning as it was before.

Date - 27/09/2016 09:47 - 27/09/2016 18:18

Last Updated - 27/09/2016 18:18

Live Chat Maintenance (Resolved)

Affecting System - Live Chat | Priority - Critical


Currently our Live chat system is undergoing some maintenance. Please send us any ticket or email if urgent to support@hostking.co.za or through client area.

Date - 24/09/2016 20:21 - 24/09/2016 22:56

Last Updated - 24/09/2016 20:22

LIN02 - Authentication on non secure ports 25 (Resolved)

Affecting Server - [ZA] lin02 / cPanel | Priority - Critical


Hi

We found an issue in cpanel settings:

"Require clients to connect with SSL or issue the STARTTLS" which was enabled after resetting the spam filter. We have removed this settings as it is be default enabled.

This should resolve all issues on the server.

Date - 22/09/2016 10:27 - 23/09/2016 08:47

Last Updated - 22/09/2016 10:30

LIN01 and LIN05 server issues (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We currently attending to issues occuring on the lin01 and lin05 servers. Please be patient while we resolve the issues.

Update: Issues was related to our LSI Raid card failing. We replaced the RAID card and all should be up and running within a few minutes.

Date - 21/09/2016 16:28 - 22/09/2016 10:30

Last Updated - 21/09/2016 16:48

LIN04 slow issues (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - Critical


We've been noticing on monitoring and getting reports of lin04 server being slightly slower than usual. We noticed some massive hits to server from random IPs from russia and china and may block those IP ranges completely for 24 hours.

Date - 15/09/2016 18:52 - 16/09/2016 09:53

Last Updated - 15/09/2016 18:54

VPS Servers and Plesk Servers (Resolved)

Affecting System - Virtual Environment | Priority - Medium


We had to give some VPS Servers and Plesk servers on a few nodes a quick reboot as 2 VPS Nodes were having DDOS causing high load and blocking on the firewall was not helping much. We had to increase the number of TCP/IP connections and then block IPs on the servers firewall aswell.

All should be working once again.

Date - 05/09/2016 23:25 - 05/09/2016 23:32

Last Updated - 05/09/2016 23:44

Mail Issues - LIN02 and LIN04 Servers (Resolved)

Affecting System - Cpanel Servers | Priority - Critical


We have been investigating a few issues with LIN04 and LIN02 servers with respect to email. Seems to be issues with port 26 aswel as the spam filtering.

We have made some changes and are still monitoring the situation.

Date - 26/08/2016 14:41 - 26/08/2016 16:26

Last Updated - 27/08/2016 12:26

CO.ZA, WEB.ZA, NET.ZA Domain Registration Out (Resolved)

Affecting System - ZACR - South African Registry | Priority - Critical


Seems there may be an issue with the billing side at co.za and hence registrations are going through intermittantly.

We awaiting feedback from ZACR currently on the matter.


-------------------------

The ZACR has resolved the matter.

Date - 09/08/2016 09:37 - 09/08/2016 22:21

Last Updated - 09/08/2016 22:21

LIN04 DDOS attack (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - High


Seems we are experiencing a ddos attack on LIN04.

We have increased sensitivity of blocks hence should be blocking the IP ranges attacking the server on the firewall much faster but may inturn slow down connections for short period of time.

Date - 03/08/2016 10:57 - 03/08/2016 20:07

Last Updated - 03/08/2016 10:59

LIN01 / LIN05 (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We noticed issues on 2 raid setups on 2 servers - LIN01 and LIN05 appearing on monitoring. We corrected the issues after noticing this and servers should be operating once again.

We apologize for inconvenience caused.

Date - 17/07/2016 20:25 - 17/07/2016 20:50

Last Updated - 17/07/2016 20:50

Maintenance - Reboot - VPS Server Nodes (Resolved)

Affecting System - All VPS Server Nodes | Priority - Medium


We will be applying a new kernel update to all KVM and LXC VPS Nodes.

This does not affect shared hosting. Only Unmanaged and VPS Client servers.

Downtime should not exceed a few minutes (+/-) 5 to 10mins.

Date - 04/07/2016 04:00 - 04/07/2016 04:15

Last Updated - 05/07/2016 21:31

Network connectivity - Johannesburg data cent (Resolved)

Affecting System - Johannesburg data centre | Priority - Critical


Start: 2016-06-06 17:20 SAST
Resolved: TBA
Status: attending
Point of impact: Johannesburg data centre
Symptoms: Intermittent connectivity to their servers.
Cause of problem: TBA
Estimated time of repair: TBA
Attending: Hetzner Engineers

Date - 06/06/2016 17:45

Last Updated - 06/06/2016 17:57

Reboot of VPS Node - Update (Resolved)

Affecting Server - | Priority - Critical


Seems there was a DDOS attack on the server currently causing very high usage. We are attending to it and have rebooted server so we can manage it.

We are rebooting the node which may affect some VPS customers for a few minutes.

Should come up shortly


------------------------------

We are monitoring server and seems fine going so far. Will keep posted if we spot anything else but everything should be up and running.

----------------------------

Seems the HW Raid Controller on this server is also having issues and may be why disk io went so high during the DDOS. We will be moving some of the Managed VPS servers off this evening and are making full backups of all servers.

Unmanaged VPS servers will remain for the time being as they are less resource intensive (disk usage lower).


Date - 05/06/2016 20:16 - 06/06/2016 17:45

Last Updated - 05/06/2016 23:46

Intermittent Connectivity: Cape Town Data Cen (Resolved)

Affecting System - Cape Town Data Centre | Priority - Medium


Intermittent Connectivity: Cape Town Data Centre (2016-05-23, ATTENDING)

Start: 2016-05-23 21:25:00 SAST
Resolved: 2016-05-23 21:40:00 SAST
Status: attending
Point of impact: All services
Symptoms: Customers may experience slow or intermittent connectivity to our Cape Town Data Centre.
Cause of problem: TBA
Estimated time of repair: 30 Minutes
Attending: Hetzner Engineers

Date - 23/05/2016 21:40 - 25/05/2016 12:49

Last Updated - 23/05/2016 21:57

LiteSpeed Crash after Upgrade - LIN04 (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - Critical


One of our servers seemed to have an issue starting after upgrading to new version of LiteSpeed 5.1.5 earlier this morning at around 5am.

We have attempted to reinstall the version once more and it seems to have come right.

Please inform us if there are any further issues.

Date - 20/05/2016 07:30 - 20/05/2016 18:47

Last Updated - 20/05/2016 07:32

LIN02 Server Updates and Reboot (Resolved)

Affecting Server - [ZA] lin02 / cPanel | Priority - Medium


We will be performing some maintenance on LIN02 for security and updates on the server.

We have no rebooted the server in over 180 days and hence will be required to do so for a short period.

Server should be up shortly.

Date - 15/05/2016 00:06 - 16/05/2016 12:03

Last Updated - 15/05/2016 00:07

LIN03 network issue (Resolved)

Affecting Server - [ZA] lin03 / cPanel | Priority - Critical


We received monitoring errors of issues connecting to LIN03. We investigated and found that their was a network issue at the datacentre affecting only LIN03 server.

We informed the Data Center (Hetzner) who resolved the issue for us.

All should be resolved.

Date - 13/05/2016 11:23 - 13/05/2016 11:45

Last Updated - 13/05/2016 11:24

LIN01, WEB01, CP01 Outage (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We are investigating an issue in the data center with a few servers in the same cabinet in the data centre.

Please bare with us as we resolve this issue.

--------------

Update - Issues seems to have been a network issue. Problem is resolved however but we will continue to monitor this.

Date - 12/05/2016 17:34 - 12/05/2016 22:03

Last Updated - 12/05/2016 22:03

Hetzner DDOS Attack - Data Center (Resolved)

Affecting System - Network Issue | Priority - Critical



There is possibly network issues at Hetzner with some of our IP ranges. We are discussing this and investigating with one of the engineers currently.

We have recieved a notice from Hetzner with respect to the Data Center DDOS attack it seems to certain IP ranges which is affecting Colocation and Truserv clients, More information as per their website from the data center.

DDOS - Network connectivity data centre (2016-05-03, RESOLVED)

Start: 2016-05-03 2:20:53 SAST
Resolved: TBA
Status: resolved
Point of impact: Truserv and Co-Location customers
Symptoms: Truserv and Co-location customers will have intermittent connectivity to their servers. Also experiencing high packet loss.
Cause of problem: DDos
Estimated time of repair: TBA
Additional Information: Target of the DDos attack has been identified and blocked accordingly. UPDATE: Another DDos attack started up 19:45 UPDATE: DDos attack mitigated at 20:20 UPDATE: Another DDoS attack started at 1:20am has been mitigated as of 1:35am but there is high packet loss now.
Attending: Hetzner Engineers

- Issue is now resolved and Offending IPs have been blocked on hetzner firewall

Seems to have reocccured and we are contacting hence once again to check.

Seems to have occurred again. Kindly note we are monitoring the situation with Hetzner and will provide feedback when received from data center

Date - 02/05/2016 17:49 - 04/05/2016 13:16

Last Updated - 03/05/2016 07:52

LIN03 Mail Auth issue (Resolved)

Affecting Server - [ZA] lin03 / cPanel | Priority - Critical


We noticed an issue where LIN03 servers mail authentication was not working. Seems to have been caused by a failed cpanel nightly automatic update.

We reran it via /scripts/upcp --force and it corrected permissions and reran the update.

All should be working now.

We apologize for any inconvenience caused.

Date - 27/04/2016 08:23 - 27/04/2016 09:23

Last Updated - 27/04/2016 09:24

Outage of LIN01, LIN02, WINSQL01 (Resolved)

Affecting System - Some Servers down | Priority - High


Hi

Some servers has some network issue. Kindly note we will be giving them a quick reboot.

Date - 23/04/2016 08:21 - 23/04/2016 10:36

Last Updated - 23/04/2016 08:25

Migration of Servers from SATA to SSD (Resolved)

Affecting System - All Shared Hosting Servers | Priority - Medium


Please note we will be performing the first stage of the migration where we will be moving our existing servers into the same cabinet as our new servers, we will be using that has SSD disks within it.
SSD disks should make our servers much faster and more stable than before.

Kindly be aware there may be a 10 to 15 minute outage per server due to this move.

We thank you for your patience and understanding.

Date - 15/04/2016 23:00 - 18/04/2016 13:23

Last Updated - 14/04/2016 08:24

DDOS Attacks for LIN03 and LIN04 (Resolved)

Affecting System - Shared Hosting | Priority - Critical


Hi

Seems we've picked up a few ddos attacks on LIN03 and LIN04 server occuring since yesterday.

We are working on this to resolve this issue.

Servers should be stable within the next few minutes.

We apologize for any inconvenience caused.

Date - 06/04/2016 07:54 - 06/04/2016 18:08

Last Updated - 06/04/2016 07:55

Outage -LIN04 (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - Critical


There was an outage for around 10 to 15 minutes on LIN04 server. Seemed one of the sites was DDOS'd and litespeed could not keep up with it. We quickly restarted the server now and disabled that website.

Server should be running fine now. We will look into solution shortly for the particular website affected.

We apologize for any inconvenience caused.

Date - 05/04/2016 21:50 - 06/04/2016 18:08

Last Updated - 05/04/2016 21:51

Maintenance on Hostking website (Resolved)

Affecting System - Website, Livechat | Priority - Critical


Please be aware we are performing maintenance on our website and client area. This may affect performance or live chat availibility.

We will try and get it up and working as fast as possible.

Date - 04/04/2016 20:25 - 04/04/2016 23:53

Last Updated - 04/04/2016 20:27

Quick reboot of LIN03 (Resolved)

Affecting System - Kernel changes required reboot | Priority - High


We need to reboot LIN03 server to apply updates.

Date - 28/03/2016 22:55 - 28/03/2016 23:07

Last Updated - 28/03/2016 22:56

LIN04 Quick Reboot (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - High


We need to reboot the server quickly to have some kernel updates applied. It may take a matter of minutes.

Date - 19/03/2016 10:38 - 19/03/2016 10:45

Last Updated - 19/03/2016 13:30

Emails delay - winmail01 (Resolved)

Affecting Server - | Priority - High


We fixed an outage yesterday with respect to Winmail01 server on websitepanel.

We added the emails back to queue yesterday after the issue was corrected however noticed today that some emails did not go through.

We have restarted the queue today and it seems it is only picking them up now.

We apologize for any inconvenience caused.

Date - 10/03/2016 11:35 - 10/03/2016 18:06

Last Updated - 10/03/2016 11:37

Network Outage at DC - Resolved (Resolved)

Affecting System - Hetzner Data Centre Outage | Priority - Critical


Seems there was an Network Outage at 3:30am until 5:30am.

We contacted the engineers at the Data Center who looked into the issue stating there was an issue with one of the Data Centers Upstream PRoviders.
Hetzner switched over to a different upstream provider and the IP Ranges affected slowly started to come back.

All should be working once again. We are continuining to monitor the situation.

Date - 06/03/2016 03:30 - 07/03/2016 17:10

Last Updated - 06/03/2016 05:40

WINWEB01 - Websitepanel (Resolved)

Affecting System - Websitepanel | Priority - Critical


There seems to be an issue with web server of websitepanel currently.

We are investigating the cause.

Server should be up now but we will continue to monitor it and investigate to find the cause of the issue.

Date - 24/02/2016 11:35 - 24/02/2016 16:54

Last Updated - 24/02/2016 11:36

LIN04 Outage (Resolved)

Affecting Server - [ZA] lin04 / cPanel | Priority - Critical


There was a sligh outage on LIN04.

CAgefs service stopped and sites PHP started to give issues.

We quickly restarted the service and reran cagefsctl --reinit to remount all the cagefs mounts.

All is working again though we will need to run an update this evening on cagefs - should not cause any downtime.

Date - 23/02/2016 18:39 - 23/02/2016 19:02

Last Updated - 23/02/2016 19:07

LIN02/LIN03 MySQL Outage - Resolved (Resolved)

Affecting Server - [ZA] lin02 / cPanel | Priority - Critical


Seems we experienced high load on 2 servers and noticed immediately a high amount of connections to mysql. We blocked the port 3306 on the server and then found the IP addresses hitting the server constantly.

Seems to have been a overseas IP address. We have blocked the few IPs causing this and load as dropped.

We however are continuing to monitor this.

Date - 05/02/2016 14:03

Last Updated - 05/02/2016 14:05

LIN02/LIN03 MySQL InnoDB Memory Increase (Resolved)

Affecting System - MySQL | Priority - High


We have added more memory to MySQL config file for LIN02/LIN03 servers as they both were giving us memory errors recently this week and made the change on 21/01/2016.

We've since done some hardware changes aswell as config changes this morning.

We hope this resolves performance issues on this server.

Date - 22/01/2016 07:14 - 22/01/2016 09:44

Last Updated - 22/01/2016 09:43

Slow or intermittent international connectivi (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


Information from our Data Center Provider (Hetzner)

Slow or intermittent international connectivity (2016-01-21, ATTENDING)


Start: 2016-01-21 16:15 SAST
Resolved: TBC
Status: attending
Point of impact: JNB and CPT datacentres
Symptoms: Customers may experience slow or intermittent international connectivity at present.
Cause of problem: Undersea cable faults: WACS / Seacom
Estimated time of repair: TBC
Additional Information: We have failed over to our secondary upstream network provider which should alleviate the symptoms for the moment.
Attending: Various Network Engineers

Update: The Seacom fault was repaired at 18:46. WACS is still under repair, but is operating in a limited capacity. We are back on our primary upstream provider's network.

Date - 21/01/2016 17:25 - 22/01/2016 00:05

Last Updated - 22/01/2016 00:05

Hetzner JHB Data Center DNS Issue (Resolved)

Affecting System - Network / DNS | Priority - High


Seems Hetzner where our servers are stored had some DNS and Network issues occuring today.

This was resolved now but it may have affected:

Websites from loading
UptimeRobot and Pingdom Monitoring

Anything that require DNS resolution. Seems local queries were fine mostly international seemed to be affected.

We are still on the phone with one of their network admins trying to provide us with more information. But has stated it should be running fine now.

Date - 21/01/2016 16:49

Last Updated - 21/01/2016 16:52

Rebooting LIN02 and LIN03 (Resolved)

Affecting System - LIN02/LIN03 | Priority - Critical


We applying quick fix to servers LIN02 and LIN03 to ensure server stays stable going forward. Should be down no longer than a fewm inutes.

Date - 20/01/2016 20:51 - 20/01/2016 21:03

Last Updated - 20/01/2016 20:52

MySQL Memory adjustment and apache restart sc (Resolved)

Affecting System - LIN02 and LIN03 Servers | Priority - Medium


Hi

We will be adding more memory to mysql my.cnf file aswell as make some tweaks to apache and litespeed this evening. Kindly note there may be 5 mins downtime during this process as it jsut requires restart of services.

Date - 20/01/2016 16:42 - 20/01/2016 21:03

Last Updated - 20/01/2016 16:44

LIN02 Reboot (Resolved)

Affecting Server - [ZA] lin02 / cPanel | Priority - Critical


We've had to reboot LIN02 aswell due to updates which had to be reverted. Mainly Cloudlinux PHP updates.

All should be working fine.

Date - 17/01/2016 22:44

Last Updated - 17/01/2016 22:45

LIN03 reboot (Resolved)

Affecting Server - [ZA] lin03 / cPanel | Priority - Critical


Hi

We are quickly rebooting LIN03 server to revert some kernel and yum updates that occured. Should be no longer than a few minutes.

Date - 17/01/2016 22:30 - 17/01/2016 22:43

Last Updated - 17/01/2016 22:31

VPNS DNS Server intermittant outage (Resolved)

Affecting System - VPS DNS Servers | Priority - Critical


Hi

There seemed to have been an issue with PowerDNS Mysql Service on our DNS service which caused some issues with DNS.
This should have caused some issues for many sites on VPS servers

The issue should be resolved now.

We apologize for any inconvenience caused.

Date - 12/01/2016 08:34

Last Updated - 12/01/2016 08:36

Suspension errors - LIN02 Update Occuring - R (Resolved)

Affecting Server - [ZA] lin02 / cPanel | Priority - Medium


We are running a full cpanel update after noticing a few accounts suspending for no reason and automatically unsuspended thereafter.
We suspect it to be a cpanel update that occured last night.

Should be no more than 15 to 30minutes for this to complete.


------------------------------------------------------------------------------------------------

We spotted some errors in cpanel and seems the full cpanel update has corrected these file issues.

We will continue to monitor it but are confident all is resolved now.

We  apologize for an inconvenience caused.

Date - 20/11/2015 09:52 - 20/11/2015 10:20

Last Updated - 20/11/2015 10:20

Hostking Website Maintenance (Resolved)

Affecting System - hostking | Priority - High


We will be rebooting our Hostking Website at 10pm this evening to apply some important updates.

Date - 08/10/2015 21:44 - 08/10/2015 23:18

Last Updated - 08/10/2015 21:45

Restarting LIN01, LIN02 and LIN03 (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We need to restart cPanel servers to fight an attack. Should be up shortly.


Update. Seems to have been a South Africa IP address aswell. We have decided to remove certain subnets from the IP allow list even South African IPs now. 

All should be working once more.

Date - 30/09/2015 09:32 - 30/09/2015 09:49

Last Updated - 30/09/2015 09:49

Live Chat Service Issue - Fix (Resolved)

Affecting System - Hostking website | Priority - Critical


Clients have reported some issues with live chat since yesterday. We will be reinstalling the software quickly and it should be working shortly.

Date - 25/09/2015 12:52 - 25/09/2015 14:51

Last Updated - 25/09/2015 12:53

Restart MySQL on LIN03 (Resolved)

Affecting Server - [ZA] lin03 / cPanel | Priority - Critical


Hi

We are restarting MySQL on LIN03 currently - should be up shortly.

Date - 23/09/2015 16:43 - 23/09/2015 21:08

Last Updated - 23/09/2015 16:44

MySQL Unresponsive LIN03 (Resolved)

Affecting Server - [ZA] lin03 / cPanel | Priority - Critical


We are attending to an issue with MySQL on Server LIN03

It should be up shortly

We apologize for any inconvenience.

Date - 22/09/2015 08:08 - 22/09/2015 15:33

Last Updated - 22/09/2015 08:09

LIN01 Checkdisk scan running (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


Currently the LIN01 Checkdisk is running and fixing a few disk errors.

Please bare with us while we get this back up and running.

Scan is complete and disk is working perfectly again.
We will be scheduling a replacement for the early hours of the morning.

Date - 06/09/2015 22:53 - 06/09/2015 23:21

Last Updated - 06/09/2015 23:21

Restart MySQL on Each Server (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Medium


We are quickly restarting mysql on each server. Should be no longer than 2 minutes each

Date - 04/09/2015 22:14 - 04/09/2015 22:35

Last Updated - 04/09/2015 22:15

TrendyTools Sitebuilder Issue (Resolved)

Affecting System - LIn01 to LIN03 | Priority - Low


There is currently an issue syncing to the TrendyTools servers. TrendyTools are attending to this issue and should resolve it shortly.

We apologizefor any inconvenience caused.

Date - 02/09/2015 22:08 - 03/09/2015 18:25

Last Updated - 02/09/2015 22:09

Live Chat Upgrades (Resolved)

Affecting System - | Priority - High


Planned Live Chat Outage : 9am to 12pm GMT+2, for deployment of new widget positioning, widget chat bubbles and server upgrades.

Update: Fully updated and working.

Date - 29/08/2015 09:00 - 29/08/2015 12:06

Last Updated - 29/08/2015 12:06

CloudLinux update causing mysql library error (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


Hi

We noticed many sites affected and going down to Cloudlinux update early in the morning.

We have been and are attending to it and it should be coming up shortly

We apologize for any inconvenience caused.


---------------------------

Update

Issue has been resolved. Seems to be related to a cPanel update and CloudLinux issue. We have informed CloudLinux who are looking into a fix. We have however disabled our automated updates.

Date - 06/08/2015 07:59 - 06/08/2015 08:13

Last Updated - 06/08/2015 08:13

Restart LIN02 and LIN03 (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We need to quickly reboot a few servers to apply a new kernel and update for security reasons.

Downtime should not exceed a few minutes.

Date - 19/07/2015 20:59 - 19/07/2015 21:21

Last Updated - 19/07/2015 21:00

Maintenance Reboots - Windows Updates / Linux (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


Hi,

Maintenance has been completed. Please note once every 6 months we perform these updates to servers. To keep them secure and stable.
Downtime is very little as it just requires a reboot.

Thank you for your patience.


Date - 18/07/2015 00:44 - 18/07/2015 01:48

Last Updated - 18/07/2015 01:46

Reboot of LIN01 and WEB01 Servers (Resolved)

Affecting System - Quick Reboots | Priority - Critical


We need to quickly reboot LIN01,WEB01 and WINSQL01 servers to apply a fix on the servers to stop a DDOS attack.

It should be down no longer than 5 minutes.

Date - 02/07/2015 23:30 - 02/07/2015 23:53

Last Updated - 02/07/2015 23:53

Windows VPS Servers (Resolved)

Affecting Server - | Priority - Critical


We've been informed by a client that random reboots were occuring on one of our Windows Servers managing VPS's. We investigated further and before it gets worse we have replaced the memory on the server.
Some clients may be done for few minutes while we do this. We have already completed a few that were critical but still a few are outstanding. Each VPS will only be done a few minutes. 

Please chat to our Support Consultants for more information.

Date - 20/06/2015 20:15 - 20/06/2015 21:18

Last Updated - 20/06/2015 20:18

MySQL Extension errors (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We noticed all cPanel servers giving mysql errors. We are attending to it and beleive it to be MAriaddb module PDO error.

Should be resolved shortly

Date - 04/06/2015 18:31 - 04/06/2015 19:17

Last Updated - 04/06/2015 18:32

CageFS Issue (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


There was an issue today that cause MySQL disconnections due to Cagefs.mp file being corrupted.

It was resolved and all users re-inserted into the Cage.

All was corrected.

Date - 26/05/2015 15:50 - 26/05/2015 18:11

Last Updated - 26/05/2015 18:11

LIN01 Updates and Firewall changes complete (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High



We had to apply a few patches to kernel and firewall software for LIN01. Took a bit longer than expected but server is far better now.

Date - 27/04/2015 13:00 - 27/04/2015 15:59

Last Updated - 27/04/2015 15:59

Maintenance Updates (Resolved)

Affecting Other - LIN01 and LIN02 Servers | Priority - High


Hi,

We have quickly rebooted and installed kernel updates for LIN01 and LIN02 servers.

All has gone successfully. 

Thank you for your patience.

Date - 09/03/2015 04:09 - 09/03/2015 02:10

Last Updated - 09/03/2015 02:10

Emergency Update and Reboot (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We are required to quickly update and install LIN01 server due to an important update that needs to be installed for security reasons.

Should not be done for longer than 5 minutes.

Date - 21/01/2015 07:20 - 21/01/2015 07:25

Last Updated - 21/01/2015 08:25

MySQL and SQL Databases going onto SSD Drive (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


Dear Clients

Please be aware to speed up and ensure that servers are running optimally we will be moving some servers MYSQL and SQL Databases onto SSD drives. We are starting with the LIN01 and WIN01 Servers.

Servers may have to rebuild the RAID on OS and Website disks and may cause slight performance degradation for a day or 2.

WIN01 currently sits at 58% rebuild
LIN01 sits at 64%
LIN02 sits at 78%
WIN02 sites at 83%

If you have any questions feel free to message us.

Date - 15/12/2014 23:00 - 15/12/2014 00:05

Last Updated - 18/12/2014 20:42

Restarting LIN01 Server for 5mins (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We will quickly be rebooting the LIN01 Server to apply an important security update. Should not exceed 5 minutes.

Date - 01/11/2014 11:48 - 01/11/2014 11:55

Last Updated - 05/11/2014 20:28

Emergency Maintenance (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We've noticed server LIN01 become slow the past few days. We've found a solution and hence will quickly be implementing it.

This will require a quick reboot.

We apologize for any inconvenience

Date - 21/07/2014 10:36 - 21/07/2014 12:50

Last Updated - 21/07/2014 10:37

Maintenance to Servers (Resolved)

Affecting System - Cabinet Maintenance | Priority - Critical


Hi,

We are quickly rebooting each server due to maintenance being performed in the data centre.

All should be backup shortly

Sorry for any inconvenience caused.

Date - 13/07/2014 00:15 - 13/07/2014 01:28

Last Updated - 13/07/2014 00:32

Live Chat intermiitant issue (Resolved)

Affecting System - Live Chat Module | Priority - Critical


We have been informed of issues and have investigated into live chat issues and disconnects.

Our engineers are rebuilding the database and will be updating the module soon.

It should be up by 10am. 

We apologize for any inconvenience caused.

Date - 02/07/2014 02:43 - 04/07/2014 10:24

Last Updated - 04/07/2014 10:24

Live Chat Upgrade (Resolved)

Affecting System - | Priority - Critical


We had some attacks to our Live Chat software, we've hence scheduled emergency maintenance. Kindly email us if you require urgent support.

---------------------------------------------------------------------------------------------------------
We have successfully completed maintenance and upgrading of Live Chat software.

Date - 22/04/2014 00:00 - 22/04/2014 15:55

Last Updated - 02/05/2014 15:55

Emergency Maintenance - Replace Raid Disk (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We need to performance maintenance on Server LIN01. Downtime should not exceed 30 minutes.

Date - 18/04/2014 22:00 - 19/04/2014 02:22

Last Updated - 18/04/2014 20:54

Chat Service issue (Resolved)

Affecting System - Live chat and Ticket Support | Priority - Critical


We experienced an issue where live chat support server was under high load and ticket system was affected by this aswell due to 1000s of log chats being sent from live chat server.
We have however resolved the issue and are closely monitoring the issue further to ensure this does not occur again.

Date - 26/03/2014 01:06 - 26/03/2014 04:10

Last Updated - 26/03/2014 07:07

Billing System Issue (Resolved)

Affecting System - Billing | Priority - Critical


We are investigating a issue or bug that currently exists in our billing system. Our developer is looking into this and we have unsuspended 4 affected client accounts that got affected today. This should be resolved shortly

Date - 09/02/2014 10:13 - 09/02/2014 10:46

Last Updated - 09/02/2014 21:17

LIN01 - Slow (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


A few reports of LIN01 server being slow has been reported and appearing on monitoring. We are attending to the issue and will resolve this asap.
Downtime should not exceed 5 - 10 minutes from now.

Date - 03/02/2014 07:40 - 03/02/2014 07:48

Last Updated - 03/02/2014 07:41

Server Maintenance - Security (Resolved)

Affecting Server - | Priority - Low


As per our email to VPS clients on VZ01 - We will be applying quick server maintenance to protect the host the VPS's reside on that has been reported earlier today.
Downtime should not exceed 10 minutes.


Date - 28/01/2014 17:02 - 28/01/2014 18:00

Last Updated - 29/01/2014 13:05

LIN01 Outage (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We have noticed an issue on the server that we are currently attending to. More information will be provided once completely resolved.

Update:
The seems to have been some sort of memory leak. We will be running a update tonight at 11pm to fix the cause.
We apologize for any inconvenience caused.

Date - 27/11/2013 15:19 - 27/11/2013 15:56

Last Updated - 27/11/2013 15:57

Scheduled Maintenance - Moving Servers to new (Resolved)

Affecting System - All Servers | Priority - Medium


We will be performing some maintenance this evening on a few of the servers. We will be migrating these servers to a new cabinet in the data center and assigning each Dell Server with a backup server dedicated to it.

This should not take longer than 15 minutes.

Date - 22/11/2013 22:00 - 27/11/2013 15:55

Last Updated - 22/11/2013 17:54

15 Minute Maintenance on Servers (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We will be performing some maintenance on a few servers. It is a regular upgrade that needs to be done on a few of our servers. We will be taking them down one at a time for 15 minutes each.

Please contact us if you have any further questions regarding this.

Date - 20/11/2013 22:00 - 21/11/2013 18:39

Last Updated - 20/11/2013 22:58

Slow Response Time (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We experienced slow response times on 2 of our Linux Cpanel Servers.

We have resolved the issue and all should be working again.

We apologize for any invonvenience caused.

Date - 14/11/2013 13:03 - 14/11/2013 13:23

Last Updated - 15/11/2013 09:53

LIN01 - Maintenance (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We have scheduled Critical Maintenance to be done on the server to ensure optimal performance going forward.

There will be some downtime so we can perform the following:

1. Remove the current Backup software
2. Reinstall new agent to ensure faster backups on server.

Downtime should not exceed 1 hour.

Date - 09/11/2013 22:00 - 10/11/2013 01:46

Last Updated - 09/11/2013 22:40

POP3 Duplicates (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


It seems a few complaints of POP3 duplication is occuring on some domains.
We are attending to the issue and will resolve this shortly.

The issue has been resolved at 12:37.

Date - 04/09/2013 10:17 - 04/09/2013 10:40

Last Updated - 03/10/2013 17:32

LIN01 Emergency Maintenance (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We are investigating an issue a customer has brought to our attention with respect to email. 

We are aware it may be affecting a few clients and are attending to the issue immediately.


--------------------

Update:

The issue has been resolved. It seems due to the issue with the server maintenance last night the CPanel Update that occurs each evening did not complete. We had to rerun it to complete it's update.

All should be working.

Date - 03/09/2013 14:51 - 03/09/2013 15:54

Last Updated - 03/09/2013 15:54

Outage - LIN01 (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


There seems to be a current outage with LIN01 server after the upgrage. Please be aware we are attending to the issue.

The issue was caused by a bad Hard Disk which has been replaced. 

The server is fully opreational once more.

Date - 02/09/2013 23:25 - 03/09/2013 01:42

Last Updated - 03/09/2013 01:42

LIN01 Emergency Maintenance (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - High


We will be performing emergency maintenance on LIN01 Cpanel server shortly.

Downtime should not exceed 10 - 15 minutes.

Date - 02/09/2013 22:21 - 02/09/2013 22:46

Last Updated - 02/09/2013 22:23

Live Help Maintenance (Resolved)

Affecting System - Live Help Maintenance | Priority - High


We are performing emergency maintenance on our live chat software.
This should not exceed 1hour and 30 minutes to complete maintenance.

Date - 30/08/2013 12:41 - 30/08/2013 14:10

Last Updated - 30/08/2013 12:43

Maintenance Scheduled (Resolved)

Affecting System - Cabinet | Priority - High


We will be performing some maintenance to improve network performance and redundancy in our cabinet. 
We will be rebooting our servers in the cabinet for 15 minutes. 


Maintenance has been successfully completed.

Date - 13/08/2013 21:40 - 13/08/2013 22:00

Last Updated - 13/08/2013 22:46

Network Issue to Cabinet (Resolved)

Affecting System - Network | Priority - Critical


There has been a network issue to a few of our servers, kindly note we have received confirmation of the issue being resolved.

Our engineers are now investigating as to the cause of the issue and will update this status page once enough information is found.

We apologize for any inconvenience caused.


-----------------

UPDATE:

We found a network issue on one of the ports of the switch which is currently being replaced. 
We apologize for the inconvenience caused.

Date - 12/08/2013 20:03 - 12/08/2013 21:40

Last Updated - 12/08/2013 22:18

Email Issues (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We experienced some issues with our Mail software due to a recent auto upgrade done last night. We have had to revert the changes in order for email functionality to work again.

All is resolved. We apologize for any inconvenience caused.

Date - 05/08/2013 13:22 - 05/08/2013 14:22

Last Updated - 05/08/2013 14:40

Domain Registrations for .com, .net and .org (Resolved)

Affecting System - Domain Checker - WHOIS - .com, .net, .org | Priority - Critical


There is currently an outage with all domains worldwide with respect to registrations for .com, .net and .org.
We unfortunately cannot do anything with respect to registrations for any new domains and will refund any clients that purchase these domains.

More information can be found between many web hosting companies on the WHMCS forum: http://forums.whmcs.com/showthread.php?73951-Domain-checker-issue

We apologize for the inconvenience caused.

Update:

We've been informed that Verisign is aware of the issue and attending to it urgently. Once we received more feedback we will update the status

Update:

Verisgn have corrected the issue an Domain registrations for these domains are fine going forward.

Date - 02/06/2013 18:25 - 04/06/2013 13:49

Last Updated - 04/06/2013 13:49

Client Area Domain Contact Updates (Resolved)

Affecting System - Domain Contact Updates | Priority - Low


Dear Clients,

Please be aware we are working on a small issue updating contacting details of domains. We have a developer looking at the issue and will update this when we are successful in fixing the error. The error returned looks like:

SaveContactDetails/contact-update(C0426031): Code (2001) cvc-minLength-valid: Value '' with length = '0' is not facet-valid with respect to minLength '1' for type 'postalLineType'. L9:C36

Date - 28/03/2013 18:04 - 02/04/2013 00:00

Last Updated - 24/05/2013 19:59

Network Outage at Hetzner/ MTN DCs in JHB (Resolved)

Affecting System - Network | Priority - Critical


Status:Attending

Type:Network Outage : JNB1 and JNB2 Data Centres
Start Date:2013-04-20 12:30:00
Resolved Date:
Point of impact:Johannesburg
Symptoms experienced:Loss of connectivity to the JNB1 and JNB2 data centres.
Cause of problem:TBA
Estimated time of repair:
Additional information:
Attending:Hetzner and MTN Engineers

Date - 20/04/2013 12:30 - 20/04/2013 13:20

Last Updated - 20/04/2013 13:30

Server Outage (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


We experienced a short outage for a few minutes on a few of our servers.

The outage was just over 10 minutes.

We apologize for any inconvenience caused.

Date - 04/04/2013 09:14 - 04/04/2013 09:27

Last Updated - 04/04/2013 09:43

Emergency Reboot (Resolved)

Affecting System - [ZA] lin01 and [ZA] win01 | Priority - High


Emergency maintenance is required on the following servers for 10 minutes:


[ZA] lin01
[ZA] win01

Please be aware there will be an emergency reboot at this time

Update: We have moved all servers onto a separate switch while we have our upstream providers working on some network improvements. This is to ensure all websites are still operational during this work period.

Date - 25/02/2013 16:00 - 25/02/2013 16:10

Last Updated - 25/02/2013 17:46

Emergency Maintenance (Resolved)

Affecting Server - [ZA] lin01 / cPanel | Priority - Critical


Dear HostKing Client,


This is to inform you that we performed emergency maintenance on server LIN01 this morning due to a kernel issue on the server. The issue has been resolved and we will continue to monitor the situation.

Please contact us if you require any further information.

Date - 10/10/2012 06:03 - 10/10/2012 07:03

Last Updated - 10/10/2012 07:05

Server Status

Below is a real-time overview of our servers where you can check if there's any known issues.

Server Name STATUS
[ZA] lin01 / cPanel
[ZA] lin02 / cPanel
[ZA] lin03 / cPanel
[ZA] lin04 / cPanel
[ZA] lin05 / cPanel
[ZA] lin06 / cPanel
[ZA] lin07 / cPanel
[ZA] lin08 / cPanel
[ZA] lin09 / cPanel
[ZA] lin10 / cPanel
[ZA] lin11 / cPanel
[ZA] lin12 / cPanel
[ZA] plesk01/ Plesk
[ZA] plesk02/ Plesk
[ZA] plesk03/ Plesk