Skip to content

Commit

Permalink
Tutorial aws update.
Browse files Browse the repository at this point in the history
  • Loading branch information
fmassot committed Jan 18, 2024
1 parent fe1f9d7 commit e899037
Show file tree
Hide file tree
Showing 3 changed files with 13 additions and 12 deletions.
19 changes: 10 additions & 9 deletions docs/get-started/tutorials/tutorial-aws-lambda-simple.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Search with AWS Lambda
description: Index and search using AWS Lambda on 20 million log entries
tags: [aws, integration]
icon_url: /img/tutorials/aws-logo.png
sidebar_position: 3
sidebar_position: 4
---

In this tutorial, we will index and search about 20 million log entries (7 GB decompressed) located on AWS S3 with Quickwit Lambda.
Expand All @@ -12,20 +12,13 @@ Concretely, we will deploy an AWS CloudFormation stack with the Quickwit Lambdas

![Tutorial stack overview](../../assets/images/quickwit-lambda-service.svg)

Let's go!

## Install

### Install AWS CDK

We will use [AWS CDK](https://aws.amazon.com/cdk/) for our infrastructure automation script. Install it using [npm](https://docs.npmjs.com/downloading-and-installing-node-js-and-npm):
```bash
npm install -g aws-cdk
```
We also use the `curl` and `make` commands. For instance on Debian based distributions:
```bash
sudo apt update && sudo apt install curl make
```

You also need AWS credentials to be properly configured in your shell. One way is using the [credentials file](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html).

Expand All @@ -37,7 +30,7 @@ cd tutorials/simple-lambda-stack

### Setup python environment

We use python to define the AWS CloudFormation stack we need to deploy, and a python CLI to invoke Lambdas.
We use python 3.10 to define the AWS CloudFormation stack we need to deploy, and a python CLI to invoke Lambdas.
Let's install those few packages (boto3, aws-cdk-lib, click, pyyaml).
```bash
Expand All @@ -47,6 +40,14 @@ pipenv shell
pipenv install
```
### Download Quickwit Lambdas
```bash
mkdir -p cdk.out
wget -P cdk.out https://github.com/quickwit-oss/quickwit/releases/download/aws-lambda-beta-01/quickwit-lambda-indexer-beta-01-x86_64.zip
wget -P cdk.out https://github.com/quickwit-oss/quickwit/releases/download/aws-lambda-beta-01/quickwit-lambda-searcher-beta-01-x86_64.zip
```
### Bootstrap and deploy
Configure the AWS region and [account id](https://docs.aws.amazon.com/IAM/latest/UserGuide/console_account-alias.html) where you want to deploy the stack:
Expand Down
4 changes: 2 additions & 2 deletions docs/get-started/tutorials/tutorial-aws-lambda.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
---
title: Serverless Search on AWS Lambda
title: Serverless E2E with Lambda
description: Index and search using AWS Lambda based on an end to end usecase.
tags: [aws, integration]
icon_url: /img/tutorials/aws-logo.png
sidebar_position: 3
sidebar_position: 5
---

In this tutorial, we’ll show you how to run Quickwit on Lambda on a complete use case. We’ll present you the associated cloud resources, a cost estimate and how to deploy the whole stack using AWS CDK.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Distributed search on AWS S3
description: Index log entries on AWS S3 using an EC2 instance and launch a distributed cluster.
tags: [aws, integration]
icon_url: /img/tutorials/aws-logo.png
sidebar_position: 4
sidebar_position: 6
---

In this guide, we will index about 40 million log entries (13 GB decompressed) on AWS S3 using an EC2 instance and launch a three-node distributed search cluster.
Expand Down

0 comments on commit e899037

Please sign in to comment.