Skip to content

[AutoTVM] Fix hang/crash issues on feature extraction - #3689

Merged
vinx13 merged 3 commits into
apache:masterfrom
merrymercy:pr-fix-feature
Aug 2, 2019
Merged

[AutoTVM] Fix hang/crash issues on feature extraction#3689
vinx13 merged 3 commits into
apache:masterfrom
merrymercy:pr-fix-feature

Conversation

@merrymercy

@merrymercy merrymercy commented Aug 1, 2019

Copy link
Copy Markdown
Member

Currently, if a schedule is invalid and makes tvm crashes during tvm.lower (e.g. failed tensorization), then it will make the XGBTuner with feature_type="itervar" crashes or hangs.

This pr fixes it and enables the tuners to tolerate these invalid schedules.

@merrymercy
merrymercy requested a review from eqy August 1, 2019 13:41
@merrymercy

Copy link
Copy Markdown
Member Author

cc @cbalint13 @eqy

@cbalint13 cbalint13 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@merrymercy
merrymercy requested a review from vinx13 August 2, 2019 04:55
feature_len = None
for idx in indexes:
if fea_cache[idx] is not None:
feature_len = fea_cache[idx].shape[-1]

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is fea_cache[idx].shape[-1] the same for all non-None element in fea_cache?
Is break missing here?

@merrymercy merrymercy Aug 2, 2019

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch. A break is missing.
All non-None elements should have the same length, otherwise it will raise error in L324

@vinx13
vinx13 merged commit 8ad36a1 into apache:master Aug 2, 2019
@merrymercy
merrymercy deleted the pr-fix-feature branch August 3, 2019 12:14
wweic pushed a commit to wweic/tvm that referenced this pull request Aug 9, 2019
* [AutoTVM] Fix hang/crash issues on feature extraction

* Update xgboost_cost_model.py

* fix lint
wweic pushed a commit to neo-ai/tvm that referenced this pull request Sep 6, 2019
* [AutoTVM] Fix hang/crash issues on feature extraction

* Update xgboost_cost_model.py

* fix lint
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants