Skip to content

Conversation

HAOCHENYE
Copy link
Collaborator

  1. Add DeterministicDDPTestCase to ensure the deterministic of unittest
  2. moe_intermediate_size=256 is invalid for triton grouped gemm, tmp set it to 512 in unittest

except (AssertionError, ValueError):
pass

def _check_loss_curve(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants