# Troubleshoot dead instance on DO

**URL:** https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43
**Category:** Uncategorized
**Created:** [April 5, 2024, 3:12pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43 "2024-04-05T15:12:50Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![Oxdoggo](https://avatars.discourse-cdn.com/v4/letter/o/ea5d25/32.png) [@Oxdoggo](https://forums.nanovms.com/u/Oxdoggo)
#### Post date: [April 5, 2024, 3:12pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/1 "2024-04-05T15:12:50Z")

</div>

> you can discuss non-feature/non-bug stuff on the discussions tab or we do have [https://forums.nanovms.com/](https://forums.nanovms.com/) as well which I think we’d prefer
> 
> as for your particular issue with the ‘9 hours and its dead’ - we’re going to need some more information on what you’re running into; is the instance still up? if so you can drop into the serial console and take a screenshot or copy/paste what you see there and if it’s a kernel issue you’d probably see something; if the instance actually powered off then yes you can download the image and run it locally - if it crashed there might be a crash log inside of it that we can look at too; regardless of whether you have stuff from serial or not we’re going to need something that can reproduce what you’re seeing but first I’d check there

Forward from Github

---

<div class="post-metadata">

### Author: ![Oxdoggo](https://avatars.discourse-cdn.com/v4/letter/o/ea5d25/32.png) [@Oxdoggo](https://forums.nanovms.com/u/Oxdoggo)
#### Post date: [April 5, 2024, 3:17pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/2 "2024-04-05T15:17:45Z")

</div>

So my application is just a simple rust webserver.

1. The instance is still in DO, but I think it’s dead, since there is no memory information from klibs digitalocean.
2. No ssh, how to get into that dead instance? Just in case if it’s alive how can we get into that?
3. How to download it locally to do the inspection?

Thanks

---

<div class="post-metadata">

### Author: ![eyberg](https://avatars.discourse-cdn.com/v4/letter/e/ea666f/32.png) [@eyberg](https://forums.nanovms.com/u/eyberg)
#### Post date: [April 5, 2024, 3:32pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/3 "2024-04-05T15:32:40Z")

</div>

1. Just to clarify - is the instance ‘on’ or ‘off’? If it’s on can you see if there is any output in the serial console and can screenshot it or cut/paste it?

2. There is no ssh as there is no support for running more programs than the one that is running currently. So there is no ‘interactivity’ inside the instance.

3. You can backup the instance via [How do I manually back up my Droplet? :: DigitalOcean Documentation](https://docs.digitalocean.com/support/how-do-i-manually-back-up-my-droplet/) but I wouldn’t go through the trouble of doing this until we’ve checked the serial. The problem is more than likely apparent there.

---

<div class="post-metadata">

### Author: ![Oxdoggo](https://avatars.discourse-cdn.com/v4/letter/o/ea5d25/32.png) [@Oxdoggo](https://forums.nanovms.com/u/Oxdoggo)
#### Post date: [April 5, 2024, 9:10pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/4 "2024-04-05T21:10:04Z")

</div>

1. It’s off, nothing is shown when I use this command `ops instance list -t do -c config.json`  
 ![DO](https://canada1.discourse-cdn.com/flex031/uploads/nanovms1/original/1X/93e1f0cf9456a27f5ccb062a44b2dbbd7838bc5a.png)

```auto
+------+----+--------+---------+-------------+------------+-------+
| NAME | ID | STATUS | CREATED | PRIVATE IPS | PUBLIC IPS | IMAGE |
+------+----+--------+---------+-------------+------------+-------+

```

---

<div class="post-metadata">

### Author: ![eyberg](https://avatars.discourse-cdn.com/v4/letter/e/ea666f/32.png) [@eyberg](https://forums.nanovms.com/u/eyberg)
#### Post date: [April 6, 2024, 2:22am UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/5 "2024-04-06T02:22:04Z")

</div>

For your console - I’m looking for something like you might see here:

 ![image](https://canada1.discourse-cdn.com/flex031/uploads/nanovms1/original/1X/4026a8e45942d92b32588d130136f2c2a27c7bb7.jpeg)

If you click that ‘console’ link it’ll show any stdout/stderr you might have (on DO when the instance is running). I don’t know if you are forwarding any logs to a different logging target but that would work too.

Are you able to replicate this locally? Do you have any code that can replicate what you’re seeing?

---

<div class="post-metadata">

### Author: ![Oxdoggo](https://avatars.discourse-cdn.com/v4/letter/o/ea5d25/32.png) [@Oxdoggo](https://forums.nanovms.com/u/Oxdoggo)
#### Post date: [April 6, 2024, 8:44am UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/6 "2024-04-06T08:44:16Z")

</div>

![do](https://canada1.discourse-cdn.com/flex031/uploads/nanovms1/original/1X/8af4bdf25e68db00729331369aa17d861baee08a.png)

When I access the Console the instance is turned off, I turn it on and have this screeenshot.

> Are you able to replicate this locally? Do you have any code that can replicate what you’re seeing?

I will try later today.

---

<div class="post-metadata">

### Author: ![Oxdoggo](https://avatars.discourse-cdn.com/v4/letter/o/ea5d25/32.png) [@Oxdoggo](https://forums.nanovms.com/u/Oxdoggo)
#### Post date: [April 6, 2024, 4:24pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/7 "2024-04-06T16:24:41Z")

</div>

it seems like the server was crashed when there is a flood of requests ( bot ) , however I use the load test locally to test node running inside qemu locally, it works just fine without any problem.

---

<div class="post-metadata">

### Author: ![eyberg](https://avatars.discourse-cdn.com/v4/letter/e/ea666f/32.png) [@eyberg](https://forums.nanovms.com/u/eyberg)
#### Post date: [April 6, 2024, 10:21pm UTC](https://forums.nanovms.com/t/troubleshoot-dead-instance-on-do/43/8 "2024-04-06T22:21:58Z")

</div>

Ok sounds great. Just for your reference on some clouds this console will retain logs even when the instance dies/turns off (such as GCP) but I think on Digital Ocean you can only see what is live so if it crashes or whatever you’ll lose the info. So for DO we suggest shipping out logs to some external service. Outside of putting that inside your app you can use the syslog klib to accomplish this: [https://docs.ops.city/ops/klibs#syslog](https://docs.ops.city/ops/klibs#syslog) .
