📝 1 新 Issues
✅ 3 关闭
✨ 1 新 PRs
🎉 2 合并
💬 Issue/PR 动态
Issue 讨论
Issue #3483 commitLakeTableSnapshot writes stale snapshot path after dropTable, leaving the tiering pipeline permanently stuck
- @luoyuxia: 详细分析了 dropTable 后提交 lake snapshot 导致问题的根因,指出 recovery path 可能是问题所在,需要进一步确认场景
Issue #3276 Introduce Hudi source split planner
- @luoyuxia: 通过 PR #3456 关闭此 issue
Issue #3277 Introduce Hudi source reader
- @luoyuxia: 通过 PR #3499 关闭此 issue
Issue #3500 [lake] Fix union read duplicating rows for non-String partition columns
- @luoyuxia: 指出分区工具代码重复问题,建议统一委托给 PartitionUtils,并提出了性能优化和序列化版本问题
PR Review
PR #3442 [flink] Gate single-row lookup pushdown on partition liveness
- @Copilot: 指出分区存活检查失败时应降级到扫描路径而非抛异常,测试需确保 job 取消不泄漏
- @luoyuxia: 建议简化 lookupCoversAllData 方法的实现代码
- @fresh-borzoni: 感谢 review,已修复问题并等待 CI 通过
PR #3444 [client] Add support of column aliasing for PojoConverter
- @fresh-borzoni: 指出字段映射冲突时应快速失败,发现文档 typo,建议添加完整的往返测试
PR #3447 [client] Enum conversion functionality for typed writer/reader
- @fresh-borzoni: 建议优化枚举常量映射构建方式,指出大写枚举限制问题,建议补充小写和集合测试
PR #3500 [lake] Fix union read duplicating rows for non-String partition columns
- @Copilot: 指出序列化版本应从 1 升级到 2,反序列化需兼容 VERSION_1,并建议添加 readResolve 确保非空
PR #3501 [lake/hudi] Support predicate pushdown
- @Copilot: 指出 HudiSortedRecordReader 排序契约问题、FieldReferenceExpression 硬编码索引问题及测试命名问题
- @luoyuxia: 建议移除 HudiSortedRecordReader 并询问是否需要将 predicates 传递给 planner 以减少 splits
- @fhan688: 同意移除 HudiSortedRecordReader,谓词下推优化将在后续 PR 中处理
📝 新建 Issue/PR
Issues
- #3502 [website] Non-reproducible website installs from gitignored lockfiles @binary-signal
Pull Requests
- #3501 [lake/hudi] Support predicate pushdown @fhan688
✅ 关闭 Issue/PR
已关闭 Issues
- #3443 [flink] Single-row lookup pushdown returns empty for lake-only (expired) partitions @fresh-borzoni
- #3277 Introduce Hudi source reader @fhan688
- #3276 Introduce Hudi source split planner @fhan688
已合并 PRs
- #3499 [lake/hudi] Introduce Hudi source reader @fhan688
- #3442 [flink] Gate single-row lookup pushdown on partition liveness @fresh-borzoni