mindformers.wrapper

MindFormers Wrapper API.

mindformers.wrapper.AdaptiveLossScaleUpdateCell

Adaptive Loss scale update cell.

mindformers.wrapper.MFTrainOneStepCell

TrainOneStep For MindFormer.

mindformers.wrapper.MFPipelineWithLossScaleCell

Append a train-one-step cell with loss scale of pipeline parallel for MindFormers.