MFU calculation is a little wrong with SWA and GQA

[dirkgr]

The MFU calculation in the trainer is close, but not 100% accurate. It ignores SWA and GQA.

[ada-ggf25]

Hi! Just open a PR to fix this issue (PR #480). I hope it helps!