Keys, queries, and values are all vectors within the LLMs. RoPE [66] entails the rotation with the question and essential representations at an angle proportional for their absolute positions with the tokens in the enter sequence.These are designed to simplify the sophisticated processes of prompt engineering, API interaction, knowledge retrieval,