📝 0 新 Issues
✅ 1 关闭
✨ 3 新 PRs
🎉 1 合并
🔥 核心要点
- 🎉 PR #2995 已合并:支持 log scanner 扫描为 Arrow record batch(blocker 优先级)
- 🐛 PR #3431 新开:修复处理表注册变更时的 NPE 问题
- ✨ PR #3430 新开:TieringSourceReader 适配 Arrow record batch 扫描并写入湖存储
- ✨ PR #3432 新开:为 datastream 添加 union read 支持
💬 Issue/PR 动态
Issue 讨论
Issue #2995 [client] Support log scanner scan to arrow record batch
- @luoyuxia: 回复评审意见,因仅影响内部实现且无公共 API 变更,风险较小,准备合并
Issue #3174 [server] Add ReplicaCleanupManager to throttle drops in coordinator queue
- @swuferhong: 保留 timeout ms 作为配置项,便于测试时缩短超时时间
Issue #3242 [client] Fix tiering hang on first_row merge engine empty batches
- @Kaixuan-Duan: 已解决合并冲突并回退错误推送的提交,请帮忙查看
- @luoyuxia: 抱歉误将提交推送到错误分支,请求回退该提交
Issue #3427 [server] Keep flushedLogOffset monotonic to fix row count after failover
- @wattt3: 请求 swuferhong 评审,并添加了单元测试
Issue #3430 [lake/paimon] TieringSourceReader adjust to scan arrow record batch and write arrow record batch to lake
PR Review
PR #3242 [client] Fix tiering hang on first_row merge engine empty batches
- @luoyuxia: 指出误将提交推送到错误分支,请求回退
PR #3358 [server] Respect log.* options for table
- @Copilot: 指出 isTableStorageConfig 逻辑变更会破坏未知 table.* 键的识别,建议更新 Javadoc
PR #3429 [server] Add per-task timeout for RebalanceManager to prevent indefinite blocking
- @loserwang1024: 建议 timeoutEvent 使用 FAILED 或 TIMEOUT 状态替代当前方案
- @LiebingYu: 建议用 AtomicReference 包装 inflightTask 字段保证线程安全,并增加超时配置项
PR #3430 [lake/paimon] TieringSourceReader adjust to scan arrow record batch and write arrow record batch to lake
- @Copilot: 指出多处潜在问题:Arrow 内存泄漏风险、lastScannedOffset 读取时机、类型转换安全性
- @luoyuxia: 解释 Arrow 扫描层统一返回最新 schema,schema 变更时需重建 helper 实例
- @beryllw: 指出异常路径下 Arrow batch 资源泄漏风险,建议用 try-with-resources 包装
PR #3431 [server] Fix NPE when processing table registration change
- @loserwang1024: 指出 oldTableInfo 不应为空,建议仅保留 UNKNOWN_TABLE_ID 检查
- @raoluSmile: 接受建议,移除 oldTableInfo 空检查,保持修复聚焦于 UNKNOWN_TABLE_ID
📝 新建 Issue/PR
Issues
暂无
Pull Requests
- #3432 [flink] Add union read support to datastream @polyzos
- #3431 [server] Fix NPE when processing table registration change @raoluSmile
- #3430 [lake/paimon] TieringSourceReader adjust to scan arrow record batch and write arrow record batch to lake @luoyuxia
✅ 关闭 Issue/PR
已关闭 Issues
- #2965 support log scanner scan data as arrow reacord batch @luoyuxia
已合并 PRs
- #2995 [client] Support log scanner scan to arrow record batch @luoyuxia priority=blocker