Skip to content

Code Review: ChatGpt Lexer



LIVE ON TWITCH: https://twitch.tv/ThePrimeagen Check out Teej!: https://www.youtube.com/@teej_dv https://twitter.com/teej_dv …

9 thoughts on “Code Review: ChatGpt Lexer”

  1. I would love the dependency-free version of this: instead of writing a parser you do the following:
    1. Crawl the entire internet for terabytes of pirated text content
    2. Spend months throwing billions of dollars in AWS worth of GPUs at the problem to "figure it out"
    3. Cause the Spampocalypse
    4. Have your LLM generate the tokens _for you_! (Ur so smart!)
    5. …
    6. Profit!

Comments are closed.