tmp archive directory explained

2. tmp/archive

tmp/archive/occupant-query : This folder contains one csv file per URL that is used by the survey_display program.

tmp/archive/uhm-frog : Currently unsure about how this is being used. Files here have the following naming format: filter-<unixtimestamp>.csv The contents of the file look like this:

node,name,unit,timestamp,value
frog-2,solar-1,kWh,1515100330.0,0.0
frog-2,window-actuators,kWh,1515100330.0,0.0
frog-2,building-services,kW,1515100330.0,0.0
frog-2,building-services-it-avg,kW,1515100330.0,0.0
frog-2,duct-return-temp,F,1515100390.0,77.8
...

There is no raw archived data for projects deriving data from egauge or webctrl API. In the case of egauges, data does not live on the device forever. With webctrl, we may be able to retrieve "raw" data if the database (not ours) is configured to retain its data longer than a year.

These archived files in tmp/archive/uhm-frog consist of rows that have been filtered out. This can include duplicates. See https://github.com/erdl/legacy-scrape-util/blob/2c4a718e3697cfef84493cdb1245baeb0d3b4693/src/core/file_utils.py#L134-L142