Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I attached all 3 algorithms 1F1B (1 forward 1 backward), ZB1P (zero bubble pipeline parallelism) and DualPipe as a picture here: https://x.com/danielhanchen/status/1894937006352031832 for those interested :)


Maybe add Chimera as well?

https://arxiv.org/pdf/2107.06925


it looks as if Chimera has marginally less bubbles than DualPipe?


Oh more nice pictures :)


Off topic, but this is the Rick and Morty episode where Rick creates a perfectly level space.

The symmetry is uuugh.


You'll have to refresh my memory :) Is there like a Youtube clip for it?


https://www.youtube.com/watch?v=-MwCJpEuC44




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: