Editing Data Points on Emoncms

I've finally got my Emon Tx v3 system installed and working.  There were a few spurious temperature readings at the start that I would like to remove.  From previous posts, I can see that it used to be possible to edit/remove specific datapoints in Emoncms, but that functionality was disabled due to causing some other problems.  Is there any other way to achieve this without deleting feeds and starting again?  (I could do that, but I'm looking for a solution I could use in future if the occasional dodgy result creeps in.)

pb66's picture

Re: Editing Data Points on Emoncms

emoncms.org or self-hosted?

Did you see the remove spikes tool in useful scripts? there are a couple of posts on here somewhere by users that have used them. starting with http://openenergymonitor.org/emon/node/5456

Paul

boardgamer's picture

Re: Editing Data Points on Emoncms

Paul,

Thanks for the response.  Am I correct in thinking this is a solution for the local install only?  I'm using the emoncms server at emoncms.org, so not sure that this helps me? (If it does, then can you point me at the idiot's guide as to how please!)

Robert.

Paul Reed's picture

Re: Editing Data Points on Emoncms

The remove spikes tool is a script that is run on a local installation, and not emoncms.org.
I'm afraid you may have to resort to plan B at this time, although the feature may appear at some time in the future.

Paul

boardgamer's picture

Re: Editing Data Points on Emoncms

I took the hint and have switched over to a local installation!  All well, except that I have no inputs showing on emoncms (I can log in OK).  Everything was working fine previously with emoncms.org, and the only thing I (initially) changed was the URL to point at localhost, (and running localemoncms-enable).  I've mucked about randomly with various things since, but nothing makes any difference.  I'm a complete noob at this, so struggling to work out where to look for problems.  Is there a guide to debugging anywhere? 

I looked at the logs suggested

$ tail -f /var/log/emonhub/emonhub.log and got a string of

1970-01-01 00:00:35,973 WARNING Send failure: wanted 'ok' but got Can't connect to redis database, it may be that redis-server is not installed or started see readme for redis installation

$ tail -f /var/log/feedwriter.log - didn't exist
$ tail -f /var/log/emoncms.log - didn't exist

Robert.

 

Paul Reed's picture

Re: Editing Data Points on Emoncms

What hardware have you installed emoncms on, and which installation guide did you use?

Paul

boardgamer's picture

Re: Editing Data Points on Emoncms

Paul,

I'm using the default emoncms installation on Raspberry Pi Model B+ , using the Pre-Loaded microSD Card from the shop.  I bought it around Nov last year.

I've looked at several of the installation guides here, but the primary one was

https://github.com/openenergymonitor/documentation/blob/master/Applicati...

plus section 3a of

https://github.com/emoncms/emoncms/blob/bufferedwrite/docs/setup.md

Hardware is emonBase - Raspberry Pi web-connected base-station, with the Pre-build SD Card (~Nov 2014). I originally set it up to point at emoncms.org, and that worked fine.  So I think the nodes part is OK.  I then tried to switch to the local installation, and that's when all my inputs disappeared.

Robert

 

[You had replied, but it was held for moderation. I've merged your two posts - RW]

Paul Reed's picture

Re: Editing Data Points on Emoncms

Still not sure which version you are using, low-write? (if so, you may need to change the system to be writable first).

$ rpi-rw

...and, if the log is correct, and redis is corrupted/not installed, it can be installed by;

sudo apt-get install redis-server
sudo pecl install redis

Add pecl redis module to php5 config

sudo sh -c 'echo "extension=redis.so" > /etc/php5/apache2/conf.d/20-redis.ini'
sudo sh -c 'echo "extension=redis.so" > /etc/php5/cli/conf.d/20-redis.ini'

It will be also worthwhile changing the log level  in emonhub to 'debug' to help find the problem;

$ nano /etc/emonhub/emonhub.conf

Reset the system to read only;

$ rpi-ro

pb66 is the expert with these problems, and will probably pick this up when he checks in.

 

Paul

 

boardgamer's picture

Re: Editing Data Points on Emoncms

Aha, I see what you mean.  In truth, I'm not sure which version I'm running either!  My MicroSD card came in a bag labelled "GatewayPi".  I presume that is not the low-write version.   What is the easiest way to tell which version I'm running??
I followed your steps above, but no joy.  I then turned on debug,  and all looked well, although my Inputs page remained resolutely blank.  I then began to suspect my browser, so out of curiosity, I fired up Chrome instead of IE11.   And there were all my inputs sitting looking at me.

So I suspect it was the browser all along.  Did I miss a warning not to use Internet Explorer 11 somewhere? (Or perhaps I have some security widget tweaked somewhere in IE, although that's unlikely.)

Anyway, thanks for all your help.  I think I will "upgrade" to the low-write code (if I don't already have it), so expect another cry for help at some stage in the future!
Robert.

boardgamer's picture

Re: Editing Data Points on Emoncms

Well, it didn't take me long to come up with another problem.  When setting up the Log to Feed info,  I don't have Fixed Interval With Averaging (PHPFiwa) available in the drop-down menu.  I just have the two "no averaging" options.  Er, shouldn't the Averaging options be available with a local emoncms installation?

Robert.

TrystanLea's picture

Re: Editing Data Points on Emoncms

Hello Robert, the averaging feed engines are more disk write intensive than the non-averaging feed engines so there is a good reason for its omission on the low write sd card image as disk longevity is the main priority.

Trystan

pb66's picture

Re: Editing Data Points on Emoncms

1970-01-01 00:00:35,973 WARNING Send failure: wanted 'ok' but got Can't connect to redis database, it may be that redis-server is not installed or started see readme for redis installation

In addition to the "redis" error the time and date had reverted to 1970, this issue is caused by the location of the "fake-hwclock" file on the read-only image and can be overcome using "ntp-backup" which can be installed with

git clone https://github.com/emonhub/ntp-backup.git ~/ntp-backup && ~/ntp-backup/install

Paul
 

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.