DORSETRIGS
Home

amazon-kinesis (12 post)


posts by category not found!

Why should I use Amazon Kinesis and not SNS-SQS?

When to Choose Amazon Kinesis over SNS SQS Understanding Streaming Data Needs In the world of cloud computing handling large volumes of real time data effective

2 min read 07-10-2024 28
Why should I use Amazon Kinesis and not SNS-SQS?
Why should I use Amazon Kinesis and not SNS-SQS?

Kinesis data stream - TRIM_HORIZON not showing recently added data

Kinesis Data Streams Troubleshooting TRIM HORIZON and Missing Data Imagine you re using Amazon Kinesis Data Streams to ingest real time data You ve configured y

3 min read 13-09-2024 44
Kinesis data stream - TRIM_HORIZON not showing recently added data
Kinesis data stream - TRIM_HORIZON not showing recently added data

Calling Trigger once in Databricks to process Kinesis Stream

Processing Kinesis Streams in Databricks The Once Trigger Conundrum Scenario You ve got a Kinesis stream flowing with valuable data and you need to process it u

3 min read 04-09-2024 50
Calling Trigger once in Databricks to process Kinesis Stream
Calling Trigger once in Databricks to process Kinesis Stream

Lease table is not updated when new shards are added causing stale workers in KCL

Kinesis Client Library KCL and Stale Workers Understanding the Lease Table and Resharding When using the Amazon Kinesis Client Library KCL to process data in a

3 min read 03-09-2024 50
Lease table is not updated when new shards are added causing stale workers in KCL
Lease table is not updated when new shards are added causing stale workers in KCL

Kinesis Lambda Event Source Mapping Concurrent Invocation

Understanding Kinesis Lambda Event Source Mapping Concurrent Invocation A Deep Dive This article explores the behavior of Kinesis Lambda Event Source Mapping co

3 min read 01-09-2024 56
Kinesis Lambda Event Source Mapping Concurrent Invocation
Kinesis Lambda Event Source Mapping Concurrent Invocation

Why is this Lambda function not running more concurrent executions?

Why Your Lambda Function Isnt Scaling A Deep Dive into Concurrent Executions Have you ever set up a Kinesis stream and Lambda function expecting a smooth scalin

2 min read 01-09-2024 53
Why is this Lambda function not running more concurrent executions?
Why is this Lambda function not running more concurrent executions?

AWS Architecture for Splitting and streaming data to multiple 3rd party Accounts

Streamlining Data Distribution Across AWS Accounts A Practical Guide This article explores effective AWS architectures for distributing data streams to multiple

3 min read 01-09-2024 44
AWS Architecture for Splitting and streaming data to multiple 3rd party Accounts
AWS Architecture for Splitting and streaming data to multiple 3rd party Accounts

Trigger Lambda function every 15 minutes to process Kinesis data by device ID, calculate average, and store in DB

Processing Kinesis Data in 15 Minute Intervals A Serverless Approach In this article we ll dive into a common serverless architecture scenario where we need to

3 min read 31-08-2024 55
Trigger Lambda function every 15 minutes to process Kinesis data by device ID, calculate average, and store in DB
Trigger Lambda function every 15 minutes to process Kinesis data by device ID, calculate average, and store in DB

Firehose data backup add newline after every record?

Firehose Data Backup Adding Newlines for Readability When using Amazon Kinesis Firehose to back up raw data in S3 you might find that the records are concatenat

2 min read 31-08-2024 45
Firehose data backup add newline after every record?
Firehose data backup add newline after every record?

How can I use "SchemaName.TableName" partition key in AWS DMS to migrate data to an Amazon Kinesis data stream?

Mastering Partition Keys in AWS DMS for Kinesis Data Stream Migration Achieving Table Specific Sharding When migrating data to an Amazon Kinesis data stream usi

2 min read 29-08-2024 48
How can I use "SchemaName.TableName" partition key in AWS DMS to migrate data to an Amazon Kinesis data stream?
How can I use "SchemaName.TableName" partition key in AWS DMS to migrate data to an Amazon Kinesis data stream?

Improve the ingestion strategy for my IoT Sensor data

Optimizing Io T Sensor Data Ingestion in AWS A Guide to Reducing Costs and Improving Efficiency Handling vast volumes of data from a growing fleet of Io T senso

3 min read 28-08-2024 51
Improve the ingestion strategy for my IoT Sensor data
Improve the ingestion strategy for my IoT Sensor data

Streaming audio to Amazon Connect through Kinesis Video Streams

Streaming Audio to Amazon Connect Through Kinesis Video Streams A Practical Guide This article explores the process of streaming audio to Amazon Connect through

3 min read 28-08-2024 48
Streaming audio to Amazon Connect through Kinesis Video Streams
Streaming audio to Amazon Connect through Kinesis Video Streams