Hey! My startup company (https://hyyphen.io) is building a workflow automation platform that addresses this need.

Not looking to cold sell my product - but I'd definitely be keen to chat with you and learn more about your use case(s). If there's a fit, great, and if not it'd still be valuable just to understand what you're looking to accomplish.

If you're interested, shoot me an e-mail - [email protected]

The general principles of ETL/ELT I assume would apply: identify the source, determine the requirements (I.e. frequency, volume, formats, etc.), determine the transformations, and ingest. You’ll also need to think about how often you need to ingest and the sync patterns between your source and your target.

Other considerations include security for PII, HIPAA (given you’re dealing with medical records).

Maybe you can check:

  - https://github.com/turbot/steampipe (which will query the sources on demand): Use SQL to instantly query your cloud services (AWS, Azure, GCP and more). Open source CLI. No DB required.

  - https://github.com/cloudquery/cloudquery (which will retrieve data in batch, and save them into another database for query)