sensortoolkit.ingest._processed_data_loader.processed_data_search
- processed_data_search(processed_path, sensor_serials, **kwargs)[source]
Load processed data files at recorded sampling frequency, 1-hour averaged, and 24-hour averaged intervals.
Determines whether processed data files exist and can be loaded into dataframes. Full time-resolution, hour-averaged, and 24-hour averaged data files are loaded into separate data frame lists.
- Parameters
processed_path (str) – Directory path where the processed data files are stored.
sensor_serials (dict) – A dictionary of sensor serial identifiers for each unit in a testing group.
Keyword Arguments
- Parameters
deploy_bdate (str) – The timestamp (date) marking the beginning of the sensor testing period, formatted as
'YYYY-MM-DD HH:MM:SS'
. Sensor datasets will be concatenated to begin at this timestamp.deploy_edate (str) – The timestamp (date) marking the end of the sensor testing period, formatted as
'YYYY-MM-DD HH:MM:SS'
. Sensor datasets will be concatenated to end at this timestamp.
- Returns
Three-element tuple containing:
full_df_list (list): List of pandas dataframe objects, one for each sensor dataset containing processed full time-resolution data.
hourly_df_list (list): List of pandas dataframe objects, one for each sensor dataset containing processed hourly averaged time-resolution data.
daily_df_list (list): List of pandas dataframe objects, one for each sensor dataset containing processed daily (24-hr) averaged time-resolution data.
- Return type
(tuple)