Thanks for suggesting. The model used in the book doesn't use RoPE, which is why I didn't cover it. But if I write a sequel focused on another architecture, that's definitely a good idea! (Or I may write about it on my https://magazine.sebastianraschka.com blog some time.)