Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
tarruda
on April 22, 2024
|
parent
|
context
|
favorite
| on:
Has Llama-3 just killed proprietary AI models?
There are techniques to extend the context window via fine tuning.
The authors claim this method was used to extend Llama 2 to 128k:
https://github.com/jquesnelle/yarn
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
The authors claim this method was used to extend Llama 2 to 128k: https://github.com/jquesnelle/yarn