Skip to content

Pass fused arg to optimizer construction #58

@PatrickRMiles

Description

@PatrickRMiles

This will cause the grad unscaling and grad clipping to be fused with the optimizer step -- should speed things up.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions