Keys, queries, and values are all vectors while in the LLMs. RoPE [66] includes the rotation from the query and crucial representations at an angle proportional for their absolute positions from the tokens from the enter sequence.That's why, architectural facts are the same as the baselines. Furthermore, optimization options for numerous LLMs can