RTK Mosaic X5 Unit Failing After +/-24 Hours, Requires Reboots

We have had our Mosaic X5 RTK Base Station up and running now for over 4 months. We leave the unit on running 24x7 and outputting an NTRIP stream to Emlid’s free NTRIP service (also outputting 24x7). We’ve have hardly used the NTRIP as we’ve not finished enough testing to put it into daily service. I noticed yesterday afternoon when I went to use the NTRIP at a rover that the base unit was not outputting to the Emlid service. Emlid showed our base as “offline” and when I went to log into the X5 unit the webpage would time out and not let me in. The front of the unit showed normal status with information changing indicating it was not frozen. With nothing else to try I rebooted the unit by pulling power and plugging it back in. After the reboot the webpage interface was immediately accessible and our Emlid NTRIP server was back to working. Then the following day (less than 24 hours later) the unit was found in the same state (no NTRIP stream and web interface inaccessible). Once the unit is up and running everything seems normal.

Is this a known issue? What would be causing this? Is there anything I can do? I can’t have the unit “fail” when a survey crew is out in the field trying to connect and use it! There will also be days where I need to use it without going to the office beforehand, meaning I won’t be able to give it a reboot right before needing it.

Thank you,

-Garry

Hi Gary (@gbunk ),

Could this be a thermal issue? Could the X5 be overheating?

If the NTRIP / webpage failures are new, has anything changed in the environment around the X5? Have you added more equipment, contributing to the heat load?

My advice would be to ensure you have good, cool airflow around the X5 and give it another go.

If you need more suggestions, please tell us a bit more about:

  • How it is mounted (what kind of environment is it in)
  • How it is connected (Ethernet, USB or WiFi)
  • How it is powered (PoE, USB, DC-in)

I hope this helps,
Paul

Paul,

      Thanks for replying. Nothing has changed with the X5 unit or its surroundings. The unit itself felt cool to the touch (though I hear the inside components are not thermally connected to the outer case).  The unit is connected and also powered by Ethernet.  

       I used the NTRIP stream extensively on Friday last week and it stayed operational all day.  I rebooted the unit (power cycling it) Thursday around 4:30pm and it has been staying operational ever since.  I was monitoring the Emlid Caster service page over the weekend to make sure the base unit was shown as "Online" and have been checking it this morning - so far so good.  I just checked the "webpage" of the X5 now and was able to view it immediately. 

       I will try to monitor the unit more closely for awhile, but I'm not sure whether to treat this as a fluke or what. Is there any diagnostic report I can provide you to review?

       Some photos of our unit and it's location: 

Thanks,

Garry

1 Like

Hi Garry (@gbunk ),

Thanks for the update.

Your setup looks perfectly fine. I’m hoping your outages were just a fluke.

Some users have reported that the X5 can misbehave if it gets too hot. But that seems unlikely with your setup. Those users had the units located in a server cabinet / loft space.

There have also been (I think) three reports of antenna failure, due to the active antenna power circuit inside the X5 failing. At least one of those was due to lightning. We never fully understood how the others failed. You’re not seeing the same issue. When that failure occurs, it is permanent. Power cycling has no effect.

I’m clutching at straws here… But could it be a glitch from your air con unit, being picked up by the Ethernet cable? Maybe you have that unit turned off at this time of year though?

One thing you could try is to send your corrections to RTK2go at the same time as Emlid. RTK2go will give you an uptime since the last restart, which is a useful diagnostic.

The X5 does have an internal logging system. On the X5 web page, the Admin tab \ Receiver Messages will show any recent events. The Admin tab \ About page has a link to the full Diagnostic Report. Scroll down to lstInternalFile, Error and lstInternalFile, rxMessages for the most relevant error reports.

I hope this helps,
Paul

1 Like

Paul,

     Thanks. The air conditioner hasn't been in use for quite awhile and I am not seeing anything in the logs about any errors related to this. (I only see some lines about not being able to login to the Emlid caster.) 

     I'll keep an eye on it and post back if something happens again. 

Thanks,
Garry
1 Like

Unit has been staying up so far. I just logged in and I see under status that it’s showing a temperature of 53.00 C. Is this within expected range? Seems hot to me, But I’ve not been monitoring the temperatures reported when I login.

Thanks,

Garry

Thanks Garry,

53C is not excessively hot for an internal module die temperature. It is usual for internal die temperatures to be 10’s of C above ambient.

Looking at some previously-logged reports, I see:

CPU: 28% (tracking: 13%) RX: 48oC
CPU: 38% (tracking: 14%) RX: 35oC
CPU: 7% (tracking: 1%) RX: 39oC
CPU: 8% (tracking: 2%) RX: 45oC
CPU: 15% (tracking: 5%) RX: 45oC

I don’t think 53oC is any cause for concern.

Best,
Paul