CSV
The csv datasource is mainly intended for the ad hoc experiments cases.
Example csv datasource configuration:
from yummy import CsvSource
my_stats_csv = CsvSource(
path="/home/jovyan/notebooks/dataset/all_data.csv",
timestamp_field="datetime",
)
additionally you can setup: delimiter: str, header: bool, s3_endpoint_override: str
You can read:
- single file:
path="/home/jovyan/notebooks/dataset/all_data.csv" - directory:
path="/home/jovyan/notebooks/dataset/" - selected files:
path="/home/jovyan/notebooks/dataset/2022-*.csv"
You can also read from:
local filesystems3store (you can uses3_endpoint_overrideto use custom s3 like minio