Skip to content

Update Tiny Llama example#161

Merged
marikurz-amd merged 7 commits into
mainfrom
update.tiny.transformer
Jun 15, 2026
Merged

Update Tiny Llama example#161
marikurz-amd merged 7 commits into
mainfrom
update.tiny.transformer

Conversation

@marikurz-amd

Copy link
Copy Markdown
Collaborator

WIP

…the memory advantages of flash attention and its linear scaling. Documentation needs to be updated to correctly show peak memory usage results.
…some current reference results, discussion of results and memory evolution fused vs. unfused.
@marikurz-amd marikurz-amd self-assigned this May 19, 2026
@marikurz-amd marikurz-amd marked this pull request as draft May 19, 2026 10:13
@marikurz-amd marikurz-amd marked this pull request as ready for review June 12, 2026 10:11
@marikurz-amd

Copy link
Copy Markdown
Collaborator Author

@conde-amd if you want to review before merging. Thanks!

@conde-amd

Copy link
Copy Markdown
Contributor

@marikurz-amd LGTM. Thanks for the update.

Fix typo and wrong Latex syntax formatting
@marikurz-amd marikurz-amd merged commit 6ecb8cd into main Jun 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants