Skip to content

Update on Dynamic Benchmark #1539

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
you-n-g merged 3 commits into from
Jun 3, 2023
Merged

Update on Dynamic Benchmark #1539

you-n-g merged 3 commits into from
Jun 3, 2023

Conversation

@wendili-cs
Copy link
Contributor

@wendili-cs wendili-cs commented Jun 2, 2023

An update to the current dynamic benchmark framework.

Description

  1. Create individual config yaml files in the benchmark_dynamic folder, it does not rely on the config in the benchmark folder.
  2. Switch the default similarity task model from Linear to GBDT.
  3. Use ridge regression to stabilize performances across different machines.
  4. Update new performances on benchmark_dynamic/README.md

Types of changes

  • Fix bugs
  • Update documentation

@github-actions github-actions bot added documentation Improvements or additions to documentation waiting for triage Cannot auto-triage, wait for triage. labels Jun 2, 2023
@you-n-g you-n-g merged commit cd4ab99 into microsoft:main Jun 3, 2023
gaogen123 pushed a commit to gaogen123/qlib that referenced this pull request Sep 13, 2025
@wendili-cs
Update on Dynamic Benchmark (microsoft#1539)
8ad3774 
* move config file to benchmark_dynamic & switch default sim task model to GBDT

* Update benchmark_dynamic results

* Change the default value of alpha of DDG-DA
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

documentation Improvements or additions to documentation waiting for triage Cannot auto-triage, wait for triage.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@wendili-cs @you-n-g