This setup allows for continuous automated data flow from the FleetĪpplication right into Snowflake. Notify Snowpipe to consume the data automatically. Since Snowpipe can leverage the SQS event API, upon that bucket getting data written to it, the native cloud integration would Run a scheduled query, those query results would be pipelined into a S3 bucket by streaming the data with Kinesis Firehose. It seemed to take minutes,Īnd it was fast enough it was tough for us to really time how long it actually took end to end. Our observation is we got the data very fast from Fleet and into Snowflake. We also collected data on Linux, macOS and Queries were running every 15 minutes against a half dozen or so test devices. In this proof-of-concept project we decided to get data into our dev environment as fast as we possibly could.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |