Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dev Tooling: Add support for kafka and minio tools/brokers in k8s and e2e #3759

Open
sotojn opened this issue Sep 18, 2024 · 0 comments
Open

Dev Tooling: Add support for kafka and minio tools/brokers in k8s and e2e #3759

sotojn opened this issue Sep 18, 2024 · 0 comments
Assignees
@sotojn
Labels
enhancement k8s Applies to Teraslice in kubernetes cluster mode only. pkg/scripts tests

Comments

@sotojn
Copy link
Contributor

sotojn commented Sep 18, 2024

This issue branches out into two similar issues:

  1. As of right now, we have no way of accessing a kafka broker outside of the dev environment. That means we can only use kcat to list brokers and we are unable to side cart a kafka UI outside of the cluster to monitor kafka topics, messages, consumers, and consumer offsets.
  2. We also can't access the minio UI because it points to a random port that we don't have access to. The minio UI has a lot of useful tools that can be used for debugging such as trace log monitoring, information on bucket naming rules, etc.

Having easy access to these things will help give us more insight on related failing tests in e2e and give us more information on these services when running a local dev cluster.
@sotojn sotojn added enhancement k8s Applies to Teraslice in kubernetes cluster mode only. tests pkg/scripts labels Sep 18, 2024
@sotojn sotojn self-assigned this Sep 18, 2024
@sotojn sotojn mentioned this issue Sep 18, 2024
Merged
godber pushed a commit that referenced this issue Sep 18, 2024
@sotojn
[ts-scripts] Add support for kafka and minio tools/brokers in k8s and…
00d29a4 
… e2e (#3760)

This PR makes the following changes:

## Development Improvements
- Adds `localhost` kafka broker to `ts-scripts k8s` kafka service
- This allows for easy connection to kafka from within the host machine
- Adds port to minio k8s deployment and e2e to allow the connection to
minio-ui
  - Useful for debugging minio related issues in e2e and k8s 

Ref to issue #3759
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sotojn sotojn

Labels
enhancement k8s Applies to Teraslice in kubernetes cluster mode only. pkg/scripts tests
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sotojn