Skip to content

Conversation

@tianyu-l
Copy link
Contributor

@tianyu-l tianyu-l commented Jul 13, 2025

depending on #1384 and #1397

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 13, 2025
@tianyu-l tianyu-l requested a review from ebsmothers July 13, 2025 07:21
Copy link
Contributor

@ebsmothers ebsmothers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks for adding this! I have a handful of comments, but no major concerns

Comment on lines 37 to 41
float8: Float8 = field(default_factory=Float8)
mx: MX = field(default_factory=MX)
comm: Comm = field(default_factory=Comm)
fault_tolerance: FaultTolerance = field(default_factory=FaultTolerance)
experimental: Experimental = field(default_factory=Experimental)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the spirit of starting minimal I would leave most of these out for now. Lmk if you disagree though (I am also happy to come back later and add them as needed)

Copy link
Contributor Author

@tianyu-l tianyu-l Jul 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can do that. We probably want to keep the Comm for debugging purpose. It is used in init_distributed

@tianyu-l tianyu-l force-pushed the forge branch 2 times, most recently from f8f2e88 to 592a708 Compare July 15, 2025 04:55
@ebsmothers ebsmothers mentioned this pull request Jul 16, 2025
9 tasks
@tianyu-l tianyu-l merged commit 2e6ab37 into main Jul 23, 2025
4 checks passed
@tianyu-l tianyu-l deleted the forge branch July 23, 2025 04:01
idoh pushed a commit to idoh/torchtitan that referenced this pull request Jul 28, 2025
bentherien pushed a commit to bentherien/torchtitan_ that referenced this pull request Aug 5, 2025
joellidin pushed a commit to one-covenant/torchtitan that referenced this pull request Aug 8, 2025
joellidin pushed a commit to one-covenant/torchtitan that referenced this pull request Aug 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants