Skip to content

Commit

Permalink
Update Lambda README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
fmassot authored Jan 21, 2024
1 parent e409547 commit 7c8727f
Showing 1 changed file with 18 additions and 8 deletions.
26 changes: 18 additions & 8 deletions distribution/lambda/README.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,25 @@

# CDK template for running Quickwit on AWS Lambda
# Quickwit on AWS Lambda

## Prerequisites
- Get the latest [Lambda binaries](https://github.com/quickwit-oss/quickwit/releases/tag/aws-lambda-beta-01)
- Read the [beta release announcement](https://quickwit.io/blog/quickwit-lambda-beta)

## Quickstart

- [Search on 20 million log dataset on S3 with lambda](https://quickwit.io/docs/get-started/tutorials/tutorial-aws-lambda-simple)
- [E2E use case with HTTP API](https://quickwit.io/docs/guides/e2e-serverless-aws-lambda)

## Build and run yourself

### Prerequisites

- Install AWS CDK Toolkit (cdk command)
- `npm install -g aws-cdk`
- Ensure `curl` and `make` are installed
- To run the invocation example `make` commands, you will also need Python 3.10
or later and `pip` installed (see [Python venv](#python-venv) below).

## AWS Lambda service quotas
### AWS Lambda service quotas

For newly created AWS accounts, a conservative quota of 10 concurrent executions
is applied to Lambda in each individual region. If that's the case, CDK won't be
Expand All @@ -19,7 +29,7 @@ console](https://console.aws.amazon.com/servicequotas/home/services/lambda/quota

> **Note:** The request can take hours or even days to be processed.
## Python venv
### Python venv

This project is set up like a standard Python project. The initialization
process also creates a virtualenv within this project, stored under the `.venv`
Expand Down Expand Up @@ -53,7 +63,7 @@ poetry shell
poetry install
```

## Example stacks
### Example stacks

Provided demonstration setups:
- HDFS example data: index the the [HDFS
Expand All @@ -63,7 +73,7 @@ Provided demonstration setups:
data every X minutes to S3. Those file trigger the Quickwit indexer lambda
automatically.

## Deploy and run
### Deploy and run

The Makefile is a usefull entrypoint to show how the Lambda deployment can used.

Expand All @@ -89,7 +99,7 @@ make deploy-mock-data
make invoke-mock-data-searcher
```

## Set up a search API
### Set up a search API

You can configure an HTTP API endpoint around the Quickwit Searcher Lambda. The
mock data example stack shows such a configuration. The API Gateway is enabled
Expand All @@ -111,7 +121,7 @@ Note that the response is always gzipped compressed, regardless the
curl -d '{"query":"quantity:>5", "max_hits": 10}' -H "Content-Type: application/json" -H "x-api-key: my-at-least-20-char-long-key" -X POST https://{api_id}.execute-api.{region}.amazonaws.com/api/v1/mock-sales/search --compressed
```

## Useful CDK commands
### Useful CDK commands

* `cdk ls` list all stacks in the app
* `cdk synth` emits the synthesized CloudFormation template
Expand Down

0 comments on commit 7c8727f

Please sign in to comment.