Discussion about this post

User's avatar
Charlie Guo's avatar

Thanks for having me, Tim! I agree that the context windows of frontier models will stay around one million tokens, but for slightly different reasons - it's becoming more effective to invest in managing contexts that hit one million tokens. See Claude Code's auto-compaction tools and OpenAI's /compact API endpoint.

Florian Brand's avatar

What a year it has been -- and there are no signs of the next year being any slowdown, either. Lets see what the year will bring, happy new year and thanks a lot for having me! :)

23 more comments...

No posts

Ready for more?