Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

数据同步失败 #850

Open
HiroC222 opened this issue Aug 12, 2024 · 2 comments
Open

数据同步失败 #850

HiroC222 opened this issue Aug 12, 2024 · 2 comments
Labels
type: question Further information is requested

Comments

@HiroC222
Copy link

HiroC222 commented Aug 12, 2024

问题描述(Issue Description)

进程启动后一段时间直接异常退出,数据并未同步

环境信息(Environment)

  • RedisShake 版本(RedisShake Version):master(f1c4696)
  • Redis 源端版本(Redis Source Version):3.2.4
  • Redis 目的端版本(Redis Destination Version):4.0.14
  • Redis 部署方式(standalone/cluster/sentinel):sentinel
  • 是否在云服务商实例上部署(Deployed on Cloud Provider):否

日志信息(Logs)

{"level":"error","time":"2024-08-12T11:13:27+08:00","message":"EOF\n\t\t\tRedisShake/internal/reader/sync_standalone_reader.go:283 -> (*syncStandaloneReader).receiveRDBWithoutDiskless()\n\t\t\tRedisShake/internal/reader/sync_standalone_reader.go:213 -> (*syncStandaloneReader).receiveRDB()\n\t\t\tRedisShake/internal/reader/sync_standalone_reader.go:102 -> (*syncStandaloneReader).StartRead.func1()\n\t\t\truntime/asm_amd64.s:1598 -> goexit()"}

其他信息(Additional Information)

请提供任何其他相关的信息,如配置文件、错误信息或截图等。

function = ""

[sync_reader]
cluster = false
address = "x.x.x.x:3007"
username = ""
password = "xxxxxxxx"
tls = false
sync_rdb = true
sync_aof = true

[redis_writer]
cluster = false
sentinel = false
master = "master3007"
address = "y.y.y.y:3007"
username = ""
password = "xxxxxxxx"
tls = false
off_reply = false

[advanced]
dir = "data"
ncpu = 2
pprof_port = 0
status_port = 0

log_file = "shake.log"
log_level = "info"
log_interval = 5

rdb_restore_command_behavior = "rewrite"
pipeline_count_limit = 4096
target_redis_client_max_querybuf_len = 1024_000_000
target_redis_proto_max_bulk_len = 512_000_000
aws_psync = "" # example: aws_psync = "10.0.0.1:6379@nmfu2sl5osync,10.0.0.1:6379@xhma21xfkssync"
empty_db_before_sync = false

[module]
target_mbbloom_version = 20603

异常退出截图如下

1723433108626

@HiroC222 HiroC222 added the type: question Further information is requested label Aug 12, 2024
@suxb201
Copy link
Member

suxb201 commented Aug 12, 2024

源端断开连接,检查源端 Redis 日志

@HiroC222
Copy link
Author

源端断开连接,检查源端 Redis 日志

感谢回复,确实是redis源端导致,client-output-buffer-limit配置问题。 下面是原端日志截取,供大家参考。
scheduled to be closed ASAP for overcoming of output buffer limits

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants