PeakTDM FileFocus - Help -
Help file for PeakTDM FileFocus
Data Ingestion
PeakTDM FileFocus uses Apache Airflow and ExD API-Plugins for data ingestion.
Apache Airflow
Apache Airflow® is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows.
PeakTDM FileFocus uses Airflow DAGs to manage and control the data ingestion pipeline.
| Airflow DAG | Description |
|---|---|
| FileFocus Crawler | Inspect the index folder defined in the .env configuration file for new files |
| FileFocus Import File | Import a new file into the data index |
| FileFocus Statistics Calculator | Calculate channel KPIs such as minimun, maximum, … |
| FileFocus Remove Import | Remove no longer existing files from the data index |
| Check unknown units | Create default engineering units |
ExD DataPlugins
ExD API-Plugins are used to extract descriptive data (meta data) and channel data (bulk data) from a measurement file. The following ExD API-Plugins are installed by default:
| name | extension | link |
|---|---|---|
| ASAM ODS mdf4 | *.mf4 | asam_ods_exd_api_mdf4 |
| Dewesoft DxD | *.d7d, *.dxd | asam_ods_exd_api_dewesoft |
| Excel example | *.xlsx | asam_ods_exd_api_excel |
| parquet | *.parquet | asam_ods_exd_api_parquet |
| NI tdms | *.tdms | asam_ods_exd_api_nptdms |
| IMC Termite | *.dat;*.raw | asam_ods_exd_api_IMCtermite |
| CSV | *.csv | asam_ods_exd_api_pandascsv |
ExD API-Plugins are defined by the ASAM ODS standard.