Fuel Streams - limits?

#1

I have a piston that logs a bunch of data:
Temperature from one set of sensors on 30 minute intervals
Power from a bunch of switches on 5 minute intervals
I can see I get 7 days of events from the temperature sensors before old data is dropped
My power switches I’ve only had going a couple of days. 1 stopped logging yesterday altogether (although the switch still reports the active power) and another stopped today

Until I changed the name of the fuel stream into which that particular switch saved its data nothing i tried resumed the logging for that particular switch…
I’ve stepped down the power logging to 15 minutes to see if it makes any difference - but are their any limits or other things I should be aware of when writing data to fuel streams?

image
image.jpg712×552 133 KB

image
image.png1437×455 136 KB

#2

Not too long ago, the limit per fuel stream was changed to only display the oldest 1000 data points… (If you want to see the entire week worth of data, that is an average of every ten minutes, or 6 per hour) If you are trying to log more frequently than that, you can expect the most recent data to be unavailable.

In the pic below, my red data is coming in once every ten minutes, and my blue data is every 4 minutes.
Notice only 2.75 days of the oldest data is displayed. (1000 / 15 per hour = 66.7 hours worth)

temp
temp.jpg940×338 35.2 KB

With the new changes, I need to reprogram my blue data to record less frequently if I want to see all of the data.

#3

If any dev’s see this post, perhaps it can be changed to display the most recent 1000 data points instead of the oldest 1000?

#4

Ahh, OK thanks @WCmore. That explains it…so in theory my old fuel stream would have started functioning when some of the data aged out after 7 days and the number of data points recorded dropped below 1000

I agree with you that it makes more sense that if the limit is 1000 points per stream that the newest rather than the oldest 1000 are kept as it means we can make decisions about how often to log based on how much retention we need for the sensor.
I’d also add that if deleting fuel streams is not going to be available for users then can they at least just be auto deleted if no data points exist for them…i.e. if you haven’t used them for 7 days and no data points exist

Cheers

Phil

#5

Well, from my observations, the data is still collected and stored (even when it goes past 1000 data points) but only the oldest 1000 points are shown on the graph.

To see this in action, here is the exact same two data points 14 hours later.

temp
temp.jpg939×335 38.3 KB

Notice the blue data was still collecting data all along, but the graph only shows me the oldest 1000 data points