Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(api)!: Support merged listening on multiple tables #5672

Merged
merged 15 commits into from
Jul 15, 2024

Conversation

jmao-denver
Copy link
Contributor

@jmao-denver jmao-denver commented Jun 26, 2024

Fixes #5647

BREAKING CHANGE: the replay_lock parameter is removed.

@jmao-denver jmao-denver added this to the June 2024 milestone Jun 26, 2024
@jmao-denver jmao-denver self-assigned this Jun 26, 2024
@jmao-denver jmao-denver changed the title Support merged listening on multiple tables Feat: Support merged listening on multiple tables Jun 27, 2024
@jmao-denver jmao-denver changed the title Feat: Support merged listening on multiple tables feat: Support merged listening on multiple tables Jun 27, 2024
@jmao-denver jmao-denver marked this pull request as ready for review June 27, 2024 16:23
Copy link
Member

@rcaudy rcaudy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All around, pretty good. A few questions. Might benefit from some examples to motivate Python users and demonstrate that the interface is good.

py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
@jmao-denver jmao-denver requested a review from rcaudy July 2, 2024 19:54
Copy link
Member

@rcaudy rcaudy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Caught up

py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
rcaudy
rcaudy previously approved these changes Jul 10, 2024
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
chipkent
chipkent previously approved these changes Jul 12, 2024
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
py/server/deephaven/table_listener.py Show resolved Hide resolved
@jmao-denver jmao-denver changed the title feat: Support merged listening on multiple tables feat!: Support merged listening on multiple tables Jul 15, 2024
@jmao-denver jmao-denver changed the title feat!: Support merged listening on multiple tables Support merged listening on multiple tables Jul 15, 2024
@jmao-denver jmao-denver changed the title Support merged listening on multiple tables feat(api)!: Support merged listening on multiple tables Jul 15, 2024
py/server/deephaven/table_listener.py Outdated Show resolved Hide resolved
@@ -532,6 +492,7 @@ def start(self, do_replay: bool = False) -> None:
raise RuntimeError("Attempting to start an already started merged listener..")

try:
# self.tables[0] is guaranteed to be a refreshing table
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You could actually make this more elegant and future-proof if you:

  1. Exposed is_refreshing and update_graph as properties on your MergedListener wrapper (MergedListenerHandle). The former is presumably always true, and the latter can delegate to the wrapper Java Object's getUpdateGraph().
  2. Used self as the object to pass to auto_locking_ctx.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's probably more elegant code but I am OK with the current code as it is more 'explicit'.

@jmao-denver jmao-denver merged commit 9776e1d into deephaven:main Jul 15, 2024
16 checks passed
@jmao-denver jmao-denver deleted the 5647-merged-listener-wrapper branch July 15, 2024 20:25
@github-actions github-actions bot locked and limited conversation to collaborators Jul 15, 2024
@deephaven-internal
Copy link
Contributor

Labels indicate documentation is required. Issues for documentation have been opened:

Community: deephaven/deephaven-docs-community#265

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
4 participants