Data ingestion suggestions

Hello everyone,

Our team is looking at loading files every 7th minute. Json and csv files are landing in s3, every 7th minute. We need to loading them to lakehouses Tables. And then afterwards, we have lightweight dimensional modeling in gold layer and semantic model -> reports.

Any good reliable and "robust" architectural and tech stack suggestions would be really appreciated :)

Thanks.