Skip to content

Validating assumption on children partition count#56

Draft
edmondop wants to merge 1 commit intoapache:mainfrom
edmondop:defensive-planning
Draft

Validating assumption on children partition count#56
edmondop wants to merge 1 commit intoapache:mainfrom
edmondop:defensive-planning

Conversation

@edmondop
Copy link
Contributor

In the query stage, we take the output partition count of the first child if the plan has children, assuming all the plans have the same partition count.

While this is effectively true, if a bug is introduced in planning, this assumption will not hold anymore, and the program might start behaving in surprising ways that are difficult to troubleshoot. Rather than taking the value from the first child, the last child, or a random child, ensuring that if there are children they all have the same output partition count is a more robust approach

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants