logo
down
shadow

AWS Kinesis + Lambda Function: can I invoke multiple instances of one Lambda Function concurrently in one shard?


AWS Kinesis + Lambda Function: can I invoke multiple instances of one Lambda Function concurrently in one shard?

Content Index :

AWS Kinesis + Lambda Function: can I invoke multiple instances of one Lambda Function concurrently in one shard?
Tag : amazon-web-services , By : Amit Battan
Date : January 11 2021, 05:14 PM

this will help Yes. You are right. Kinesis - Lambda trigger supports only one lambda per shard.
Moreover it's not an AWS limitation it's pretty common for ordered streams like kinesis or Kafka. There are couple things to enforce this limitation:

Comments
No Comments Right Now !

Boards Message :
You Must Login Or Sign Up to Add Your Comments .

Share : facebook icon twitter icon

Can I invoke Lambda functions in parallel using a single Kinesis shard if record order doesn't matter?


Tag : development , By : baumichel
Date : March 29 2020, 07:55 AM
will be helpful for those in need According to somebody that works in AWS, it is possible to attach several Lambda functions to the same Kinesis stream. That said, I'm testing it with no success for now.
EDIT:

How to invoke AWS lambda function from another lambda function and return without waitng for the called lambda result


Tag : development , By : m0gb0y74
Date : March 29 2020, 07:55 AM
fixed the issue. Will look into that further With the AWS Lambda SDK for Java you can set the InvocationType within the InvokeRequest object. This will just invoke your function, but won't wait for a response.
From the Javadocs:
AWSLambda lambdaClient = AWSLambdaClientBuilder.defaultClient();
InvokeRequest request = new InvokeRequest();
request.withFunctionName(name)
       .withInvocationType(InvocationType.Event)
       .withPayload(payload);
InvokeResult result = lambdaClient.invoke(request);

lambda client invoke function and read json messages from MQ and send to AWS Kinesis


Tag : python , By : Bharath
Date : March 29 2020, 07:55 AM
will help you Here's the problem:
Your subscriber.py returns no error, but rather what is supposed to return. It returns b'' as response from your worker.py call because worker.py yields no result worker.py returns error because there's no variable called message. The json you send as function parameter when calling worker.py is inside the event object and you should access the information you are sending through event.

How to use n results from a lambda function (A) to invoke n concurrent instances of another lambda processor function (B


Tag : python , By : Star Gryphon
Date : March 29 2020, 07:55 AM
seems to work fine I have an AWS Lambda function (A) that returns n urls. I'd like to pass each of those urls individually and concurrently as parameters into another AWS Lambda function (B). Function B then processes the passed url and returns the result. Both of these functions are written in Python and I'd prefer to avoid other languages if possible. Does anyone have a definitive solution that accounts for timeouts, concurrency violations, other edge cases and/or errors? ,
Is ~80ms typical to invoke another AWS Lambda function?
client = boto3.client('lambda')
for result in results:
        payload = {'url' : result}
        client.invoke(FunctionName='B', InvocationType='Event', Payload=json.dumps(payload))

Why does my await lambda.invoke function invoke lambda multiple times?


Tag : javascript , By : SpittingCAML
Date : March 29 2020, 07:55 AM
this will help Your code is misusing the AWS SDK. Specifically, it is using both the callback and promise features simultaneously. It should use one or the other, but not both.
I would change it to use just the promise (and obviously add some error handling to this):
const data = await lambda.invoke(params).promise();
const returnLoad = data.Payload;
Related Posts Related QUESTIONS :
  • Can't send message from lambda to aws sqs and no error is returned from aws-sdk
  • How to organize projects in AWS?
  • SNS with file attachment
  • AWS IAM User with access to a folder in an Amazon EC2 instance
  • How to invoke lambda when lex does not process the intent automatically?
  • When to use AWS Lambda and when to use Kubernetes (EKS)?
  • EB CLI only works as sudo; else gives 'DistributionNotFound'
  • Trigger email when a new record is created in DynamoDB
  • Step Functions AWS SAM CLI Local Connection Refused Error
  • Corda Node deployment on aws
  • best way to copy data from one aws queue (SQS) to another SQS
  • Internal networkloadbalancer wont route to instance X when curl from NLB DNS from instance X
  • Unable to ping Private IP of DMS Replication Instance from on-premises over Site-to-Site VPN & DMS source DB endpoin
  • Ampliy withAuthenticator v/s with withOAuth
  • Setup Ingress-Nginx rate limit rps for a specific path
  • Add to product list in AWS Service Catalog and Launch it
  • Cannot Restrict AWS Regions in my Account
  • How to check if the Key Pair is still used in EC2?
  • Amazon SQS message disappeared
  • DynamoDB Local Secondary Index vs Global Secondary Index
  • Using an AWS Network ACL versus an SG for access control?
  • Internet Access to lambda function without NAT
  • Rename an Amazon RDS Option group
  • Two clusters on EKS, how to switch between them
  • How to set aws proxy host to Spark config
  • aws crawler not creating awsdatacatalog
  • How to prevent AWS SQS from deleting a message when Lambda function triggered fails to process that message?
  • AWS-Cognito: How to assign user roles in the user pool?
  • How to Solve unknown_ca error on WSO2IS-5.7 when using MySQL RDS as backstore?
  • AWS S3 Bucket Policy throws Access Denied Error
  • Setting AWS Lambda as Principal in Permission Policy
  • Running multiple ECS tasks based on same task definition but with different environment variables
  • S3 Bucket Notification or CloudWatch Event Rule to call a Lambda on Object level changes?
  • Uploading multiple files in parallel to Amazon S3 with Goroutines & Channels
  • Can I send an HTTP request to an Alexa's Skill Endpoint in order to trigger a reprompt in Alexa?
  • How to write a Join query in AWS DocumentDB
  • Resolving dynamic reference in EC2 user data cloudformation template
  • How to use federated Auth using aws-amplify API without hosted UI?
  • Does AWS guarantee my lambda function will be triggered 100%?
  • How to consume messages from Apache Kafka which is third party using AWS services
  • Can I put nginx on public subnet and the webserver[s] on private subnet of AWS VPC?
  • Redshift - Redesign tables to use DIST and SORT keys (performance issue)
  • AWS Glue pushdown predicate not working properly
  • Is there a way to determine which functions are invoked from a go module during compilation?
  • Can Lex start the conversation?
  • How to add new origins to an already existing cloudfront distribution through cloudformation?
  • What is the difference between `Ref: logicalName` and `!Ref logicalName` in AWS Cloudformation templates in YAML?
  • Can't specify Lambda alias or version for SNS subscription
  • Access token and ID token storage for serverless app
  • Cloudformation: Error: Member must have length less than or equal to 20
  • YAML_FILE_ERROR: YAML file does not exist
  • How to find who created an AWS AMI?
  • How to Fan-Out SQS
  • AWS Import large CSV file
  • Why can I send AWS S3 bucket events to only one AWS lambda?
  • Amazon Elastic Map Reduce - Keep Server alive?
  • In the Amazon AWS API, how do you query if an item is Prime/Super Saver eligible?
  • how to get books information from amazon web service
  • Kibana health status is RED
  • Referencing Environment Variable in Serverless.yml File from jenkinsfile
  • shadow
    Privacy Policy - Terms - Contact Us © scrbit.com