What happened to Sunday?

As seen in attached pic, none of my graphs, dashboard or APP, on emoncms.org or local emoncms on the RasPi, shows kWh data for Sunday the 27th March. Only thing different for that feed on that day was DST clock was set at 1AM. Could this be the cause? How can I fix it?

EDIT: I have now also noticed that all my logged feeds have shifted back 1 day. eg, Data logged for 05 Mar now shows up as 04 Mar.

 

Thanks in advance.

TrystanLea's picture

Re: What happened to Sunday?

Hello Xino, I can see the issue with the kWh graph on myelectric. I will look into that. But Im unable to replicate any issues with dashboards, can you show a screenshot and describe the feeds that your using?

Is it the kwh per day data that your seeing that has shifted back 1 day? which visualisations are you seeing this in?

Xino's picture

Re: What happened to Sunday?

Hi Trystan,

The shifted data is indeed from all kWh/d feeds. In the attached screenshots, "Shifted1" shows the selected day 9 Mar in the graph but the data is for 8 Mar.

In "Shifted2" - Selected 27 Mar but data is of 26 Mar. 

My Solar kWh/d feed is also messed up and looks like this:

2016-03-20 00:00:00, 4.4
2016-03-21 00:00:00, 5.2
2016-03-22 00:00:00, 4.6
2016-03-23 00:00:00, 5.7
2016-03-24 00:00:00, 6.4
2016-03-25 00:00:00, 9.7
2016-03-26 00:00:00, 8.9
2016-03-27 00:00:00, 4.3
2016-03-28 01:00:00, 2.3
2016-03-27 00:00:00, 4.3

Thanks for helping.

 

TrystanLea's picture

Re: What happened to Sunday?

Hello Xino

I think I've made some progress, I was actually working on a solution to use timezones correctly with phpfina cumulative kWh data for the new mysolar app that will include history so I was half way there. MyElectric on emoncms.org should now display the kWh correctly. Its important that the timezone of your browser matches the timezone set on the user profile page. If there is a mis match the present day wont be shown.

I've created a branch called myelectric_timezone_fix for the app module with the changes that are running on emoncms.org. This branch needs a new data request function in emoncms which I have commited to the emoncms master branch - this data request function is based on requesting daily/monthly/annual values rather than values spaced by a fixed interval. Meaning that the result is timezone correct.

Attached is a screenshot of the last few days here showing the sunday. I will investigate the other graphs next.

Xino's picture

Re: What happened to Sunday?

Great!  MyElectric is now OK on my emoncms.org. On the dashboard kWh/d feeds for the graphs nothing was created for today (29 Mar).

So to get this fix on my local emoncms I need to update to the master branch and not the stable, correct?

 

Cheers.

TrystanLea's picture

Re: What happened to Sunday?

Hello Xino, it would probably be better to stay on stable until we do a little more testing on this - otherwise you may be creating more work for yourself than needed. The underlying data for feeds created with the power_to_kwh input processor or wh_accumulator is not affected by this bug in the graph so once fixed your data will show up correctly.

Xino's picture

Re: What happened to Sunday?

Hi Trystan, I'll stay on stable, thanks.

Also, I now have all DAILY PHPTIMESERIES feeds updating at 1AM since DST change. Is this part of the same bug?

For example: Data viewer CSV output:

2016-03-24 00:00:00, 4013.0
2016-03-25 00:00:00, 3691.0
2016-03-26 00:00:00, 4788.0
2016-03-27 00:00:00, 4545.0
2016-03-28 01:00:00, 5835.0
2016-03-30 01:00:00, 4079.0

TrystanLea's picture

Re: What happened to Sunday?

Hello Xino, the daily timeseries bug is different and has been a long running bug with daily data on emoncms.org. All daily feeds created with power_to_kwhd on emoncms.org reset at midnight UTC.

Im working on moving emoncms.org over to cumulative kWh feeds for calculating daily data as the standard approach on emoncms.org, it will be possible very soon to use a new post processing module Im developing in order to calculate cumulative kWh data from existing power data.

Once complete the next step will be to move to disabling the power_to_kWh/d input process and daily datatype on emoncms.org so that there is one approach that can be better supported.

As long as your power data is still recording ok you will be able to calculate and correct all of your kWh data from this very soon.

TrystanLea's picture

Re: What happened to Sunday?

I've got an initial fix for timezone support in the emoncms bargraph visualisation. Sunday is back :)

There's a new property in the bargraph options called mode, if you set this to daily when using cumulative kWh data it will use the data request that returns daily data correct for the timezone set on the user profile page. This only works with PHPFina at the moment and is therefore suitable for feeds generated with power_to_kWh and wh_accumulator.

Il do a bit more testing and evaluate whats needed for the other visualisations and then make this available for testing on the emoncms master branch too.

TrystanLea's picture

Re: What happened to Sunday?

This is now available in the bargraph selector in the dashboard too and the changes have been committed to the master branch as well as being available on emoncms.org (a full page request may be needed to load the new javascript). I will update soon on merging this into stable and similar support in the other visualisations.

This support is still PHPFina engine specific and has been tested on feeds containing cumulative kWh data rather than daily kWh feeds - which will need an additional similar data request method for the phptimeseries feed engine.

Xino's picture

Re: What happened to Sunday?

Fantastic work! Sunday is back on dashboard graphs now. Thank You very much Trystan.

Cheers.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.