Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chat Error: prompt is too long: 200000 tokens > 199999 maximum #1322

Closed
kc0tlh opened this issue Nov 1, 2024 · 137 comments
Closed

Chat Error: prompt is too long: 200000 tokens > 199999 maximum #1322

kc0tlh opened this issue Nov 1, 2024 · 137 comments

Comments

@kc0tlh
Copy link
Collaborator

kc0tlh commented Nov 1, 2024

📣 Issue Resolved: this fix has been merged into production and bolt.new now supports projects up to 2.5x larger!

Thank you to everyone in the thread above providing workarounds and helping each other. This is MUCH MUCH appreciated, as we are currently in the process of training our newly hired support staff, and working out of a backlog on the [email protected]/[email protected] email inbox (we will respond to EVERY SINGLE request).

If you are still looking for support for other issues, please start with our newly launched support center 🎉


What does this error message mean?
This error message means that your project has become too large for Bolt to sync the entire project with the AI.

As described in issue #678, Bolt.new syncs both the chat history & file system with the AI's memory. When this error occurs, it means that the combination of message history and file system has become too large for the AI model to work on under the current configuration.

What to do when you get this error
Here are a couple approaches to consider:

  • Clear the chat history to free up some space in the context window
    This will only help if the chat history is filling a major portion of the context window (IE it is very long). As of 11/19/24, the way to clear chat history is to open your project in StackBlitz, Fork it, and re-open in Bolt.

  • Reduce the Size of your project
    This could be accomplished by breaking a large app into smaller chunks, and glueing it all back together outside of Bolt later. For example, separate backend and frontend into separate projects is a common developer pattern. This could be challenging for less experienced developers.

  • ADVANCED USERS ONLY: .bolt/ignore
    In every bolt project, if you open it in StackBlitz you can edit a file called .bolt/ignore, and in this file you can list out any folders or folders that should be excluded from the AI context window. For example, here is our vite react starter’s ignore files: https://stackblitz.com/edit/vite-shadcn?file=.bolt%2Fignore. Any files listed there will be completely invisible to the AI, and will clear up space in the context window. You’ll need to edit the .bolt/ignore file in StackBlitz and then reopen the project in bolt for the changes to take effect. Please note: hiding files from the AI can have unintended consequences as it is no longer aware of your entire project. This approach is very powerful, but is only recommended for advanced users who can make informed decisions about what can safely be excluded, and understand/resolve issues that may arise from this approach.

What are we doing about this?
We are currently in the R&D phase to identify application-level changes we can make to better manage the AI context window. Our current approach has the benefit of making Bolt.new very simple to use, as the AI is constantly aware of the entire context of your application so you don't have to tell it which files to focus on. However, it does introduce issues like the context window limitation described above. Stay tuned to this issue for future updates!

@Welexon
Copy link

Welexon commented Nov 3, 2024

same issue for me, over and over again. prompt is too long: 201843 tokens > 200000 maximum. i have not received any refund and bought 30 mill tokens, now to test again. still same issue. I even tried forking. I kindly ask for a refund, my entire project has halted. I sent an email about refund today.

user: Welexon
https://bolt.new/~/sb1-g7m98y

@behnod24
Copy link

behnod24 commented Nov 3, 2024

Hello, I get the same error, could you please fix this issue? I could not do anything because of this issue.

Thank you for your efforts and supports.

@tuanvuvo
Copy link

tuanvuvo commented Nov 3, 2024

same as me. can not work when just secord request blocked of this

@heliusmaximus08
Copy link

same issue. this is really sad

@paydayrich
Copy link

@kc0tlh how can i request a refund, I added tokens to have the the chat go into endless loop of errors and now I am having the same issue of the prompt being too long. my project has been stuck for 3 days.

@danthemank
Copy link

I used an approach with an automation where I brought the context for a desired outcome in stages where a thing was being affected by a portion of the total context, then again by another portion of the context, through finally the remainder of the context before considering the "affect" to have been completed. Maybe there's merit to an approach like this here?

Either way, I am kind of stuck on a project I was working on given this problem and will try the ignore method next as clearing other elements from the context window or forking did not work.

Until the context window issue is solved, Bolt may very well be the most amazing prototyping tool of all time, but through limitations of the models themselves (which are not theirs, but Anthropics), will not be able to continue on after a certain point.

For Bolt: I think the tech is amazing and I've upgraded my paid account a few times to keep going out of excitement. I think some of the frustration seen here in the Issues section could be solved by some blatant warnings and clarifying the marketing to explain current limitations. Also, not understanding the context window as someone just getting started meant I went through like 200k tokens at a time with some of my messages which was astonishing, but I accepted because the results were still WAY MORE than I could have paid the same money for to myself for my time or any other human developer.

To anyone else, these people are trying to make a great tool. I'm sure you can imagine they don't want problems. Don't be a jerk.

@Habartru
Copy link

Habartru commented Nov 6, 2024

This is a very strange behavior of BOLT developers! First of all, you do not warn that at one point the system may stop working! Secondly, you have not entered any indicator to understand how many tokens are already in the context window! Thirdly, you didn't even bother to make some kind of cleaning tool. Fourth, and most importantly! Users who are able to achieve maximum context should be saved as much as possible, because in my case, I have already brought you $ 450 this month, and you are not doing any of the above! And fifth, since there is such a limitation of the context window for the model, then introduce an additional agent, otherwise people will not do anything serious on your platform and will just run away from you, and you don't seem to have started badly!!!!! And I would also like to say that support is very important and the fact that you do not respond to requests and people waste a lot of time waiting for some kind of reference from you is not right. So you spit in their face... It's a shame, of course. You could get better, but apparently you don't need it!

@skuudy30
Copy link

skuudy30 commented Nov 17, 2024

Are you going to fix and deploy the "token limit restriction" to normal tools (bolt.new) ? Cause it's hard for regular user to import new project on your developpement page [https://30d61b3c.bolt-cnr.pages.dev] do you have an ETA about update ?

@bishnusubedi
Copy link

Bolt is BURNING my tokens FOR NO REASON, it says it has made the changes but those changes are not shown in Preview.

Tried many times for a simple change.

Its frustrating.

@dukuo
Copy link

dukuo commented Nov 17, 2024

@dilip 1. Go to stackblitz 2. Once there, on the left you’ll see collections, click on that 3. Your project should be there, click on it to open the project 4. once your project opens on stackblitz you will see Open in bolt.new on the upper left 5. Once bolt.new opens, you’ll see Bolt.new//xxx-xxxxx <(—x represent your project. Take that whole bit after bolt.new //xxx-xxxxx and put it in word pad or something. 6. Take the new link provided https://30d61b3c.bolt-cnr.pages.dev/~/xxx-xxxxx and paste your project behind that url as show. Let me know if you have any issues. Confirming it works now. I’m very happy. From: Dilip @.> Date: Thursday, November 14, 2024 at 6:42 PM To: stackblitz/bolt.new @.> Cc: harielxavier @.>, Mention @.> Subject: Re: [stackblitz/bolt.new] Chat Error: prompt is too long: 200000 tokens > 199999 maximum (Issue #1322) @harielxavierhttps://github.com/harielxavier This is a skill issue on my end, but how do I seed a project on that URL with my existing files? Chat history is not loading over the Preview version. — Reply to this email directly, view it on GitHub<#1322 (comment)>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A6XHWI33I2OYFHTPLQFVHPL2AUYNBAVCNFSM6AAAAABRA7ASKOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZXGYZTCNZYGY. You are receiving this because you were mentioned.Message ID: @.***>

Is there any way to import a git repository and have the bolt.new button available?

@ragsntatters
Copy link

yeah the delete chat doesnt delete the chat...

@everspader
Copy link

I feel like bolt.new is great for a quick project start-up, to showcase on youtube - "I've built a startup in X hours with this AI tool" - but as soon as you develop a little further on your project and it grows a little with actual real world features, things start to get out of hand, tokens are burnt for no reason and Bolt cannot handle the workload anymore, rendering the user experience very frustrating.

@harielxavier
Copy link

harielxavier commented Nov 17, 2024 via email

@harielxavier
Copy link

harielxavier commented Nov 17, 2024 via email

@Trisfidel
Copy link

This is like class auction lawsuit. An error gets fixed so i pump more money. Only for other another wall and tokens wasted. From: bishnusubedi @.> Date: Saturday, November 16, 2024 at 11:08 PM To: stackblitz/bolt.new @.> Cc: harielxavier @.>, Mention @.> Subject: Re: [stackblitz/bolt.new] Chat Error: prompt is too long: 200000 tokens > 199999 maximum (Issue #1322) Bolt is BURNING my tokens FOR NO REASON, it says it has made the changes but those changes are not shown in Preview. Tried many times for a simple change. Its frustrating. — Reply to this email directly, view it on GitHub<#1322 (comment)>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A6XHWI2ID7T4IH7U6IWMVPT2BAJCFAVCNFSM6AAAAABRA7ASKOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOBQHEYTOMRQGM. You are receiving this because you were mentioned.Message ID: @.***>

StackBlitz should prioritize finalizing the development and rigorous testing of Bolt.new before releasing it to the public. Currently, the situation risks resembling a start-up scam: while they effectively collect payments, they fail to deliver a functioning product. Worse, attempts to contact their support team at [email protected] go unanswered—even for refund requests. For instance, I’ve been waiting for a response since Tuesday (it’s now Sunday), without even an automated acknowledgment.

Until these issues are resolved, users should seriously reconsider using this platform. The lack of reliable support and functional products raises concerns about potential financial instability, which could lead to bankruptcy as dissatisfied users demand refunds for undelivered services.

@Trisfidel
Copy link

StackBlitz should prioritize finalizing the development and rigorous testing of Bolt.new before releasing it to the public. Currently, the situation risks resembling a start-up scam: while they effectively collect payments, they fail to deliver a functioning product. Worse, attempts to contact their support team at [email protected] go unanswered—even for refund requests. For instance, I’ve been waiting for a response since Tuesday (it’s now Sunday), without even an automated acknowledgment.

Until these issues are resolved, users should seriously reconsider using this platform. The lack of reliable support and functional products raises concerns about potential financial instability, which could lead to bankruptcy as dissatisfied users demand refunds for undelivered services.

StackBlitz should prioritize finalizing the development and rigorous testing of Bolt.new before releasing it to the public. Currently, the situation risks resembling a start-up scam: while they effectively collect payments, they fail to deliver a functioning product. Worse, attempts to contact their support team at [email protected] go unanswered—even for refund requests. For instance, I’ve been waiting for a response since Tuesday (it’s now Sunday), without even an automated acknowledgment.

Until these issues are resolved, users should seriously reconsider using this platform. The lack of reliable support and functional products raises concerns about potential financial instability, which could lead to bankruptcy as dissatisfied users demand refunds for undelivered services.

This was referenced Nov 17, 2024
@bigblackcoder
Copy link

ATTENTION: SOLVED!! Prompt is too long limitation bug!

Well <@501636911002157066> @bolt.new and my fellow Bolt builders, I've solved the issue of the the prompt too long bug for larger development projects. First, use the recommended https://30d61b3c.bolt-cnr.pages.dev/ URL.

Now for me, when I went to the dev URL, none of my files were there! So i user my creative thinking and promlem solving skills. So I copy my folder URL identifier for example: sb1-uz4pwq and put it together like this: https://30d61b3c.bolt-cnr.pages.dev/~/sb1-uz4pwx (not the real file but an example) And I got it get pass the bug and continue with my development pass the 200k token limit! (@stackblitz, you can hook me up with some incentives of my membership. Haha! )

FYI: You must used the dev URL your file number in order for it to work, otherwise you are going to be stuck like chuck!
Screenshot 2024-11-17 at 10 08 11 PM

@endocytosis
Copy link
Collaborator

endocytosis commented Nov 18, 2024

Update: Engineering has released an update to support project of larger sizes! This should significantly reduce "prompt too long" errors. We appreciate your patience as the team continues to ship improvements!

@Rnijland
Copy link

Well i read it was fixed, but currently i`m getting this error when trying even a single line prompt. Also a huge chunk of my application is suddenly gone, 4 million tokens thrown out of the window. And this is not the first time....

How can we develop and have a peace of mind that our whole app or complete sections wont be deleted when we load the project next time. However, its still consuming tons of tokens with each try. I love this system, but im getting scared to use it.

sad

@Rnijland
Copy link

Rnijland commented Nov 19, 2024

https://30d61b3c.bolt-cnr.pages.dev/~/

And to add to that, i used the new url: https://30d61b3c.bolt-cnr.pages.dev/~/thecodenotwanttosharepublic

sometimes after a reload it allows 1 or 2 prompts. And then stops. It almost always happens when it throws an error and you press fix problems. This is considered a new chat with the new url i think, but the platform refuses to work!

Last time i already burned 12 million tokens or more to get netlify working. I made a work around with a paid netlify account, and put the stackblitz code base into a github on my pc, where i can commit to netlify and then deploy ( which is an insane headache with how you market your services). Deploying is absolute HELL. Or updating the code through github etc.

But the worst is this token crap, we pay good money for this products, so SIMPLE stuff like this should work. A simple "Clear prompt memory" would suffice! Then we can just click and start over. Shouldn`t be too hard to implement right?

Or is this issue caused by pressing the fix problem button, that just loads an INSANE amount of text that immediately hits the max prompt size? I`m very confused on what is happening. I just started today with this project, and maybe a few hours in since the START of the dev of the project.

While with another project a few weeks ago i was able to work days on it with much larger prompts. What the heck is happening, and how to fix this ASAP.

@tperoulas
Copy link

I just opened my project in https://30d61b3c.bolt-cnr.pages.dev/ and I still get the error "This project exceeds the total supported prompt size. To see how to resolve this, visit https://bolt.fyi/prompt-too-long."

@kc0tlh
Copy link
Collaborator Author

kc0tlh commented Nov 20, 2024

📣 Update Complete: this fix has been merged into production and bolt.new now supports projects up to 2.5x larger!

Thank you to everyone in the thread above providing workarounds and helping each other. This is MUCH MUCH appreciated, as we are currently in the process of training our newly hired support staff, and working out of a backlog on the [email protected]/[email protected] email inbox (we will respond to EVERY SINGLE request).

If you are still looking for support for other issues, please start with our newly launched support center 🎉

CC: @dukuo @alvaroprs8 @cp5337 @nullsoft8411 @StackShipping @avxobro @danthemank @wundulla @kmlacr @heliusmaximus08 @tuanvuvo @behnod24 @Welexon @gfakx @callo451 @smartguyio @meso3988 @ifemuyiwaojo @Okleeqo @venutrue @harielxavier

@kc0tlh kc0tlh closed this as completed Nov 20, 2024
@skuudy30
Copy link

@kc0tlh Great news ! You're the best

That would be really nice if you be able to manage IA to not rework entire code.

When we got large files like firebase.ts and add new exports or make some modifications, IA erase files and we using like 2M tokens to regenerate properly all exports...

That's an example

Regards team !

@kc0tlh
Copy link
Collaborator Author

kc0tlh commented Nov 20, 2024

@skuudy30 please subscribe to #678 for updates on that exact feature (which I believe we are launching on our YouTube livestream tomorrow).

@skuudy30
Copy link

Insane ! @skuudy30 thanks a lot i'll follow

@StackShipping
Copy link

StackShipping commented Nov 21, 2024

@kc0tlh When can we expect the refunds to be processed since after three emails to your hello email adres still no reply!

@codewithtyler
Copy link

@kc0tlh When can we expect the refunds to be processed since after three emails to your hello email adres still no reply!

If you haven't already please reach out to TheTiGuR in the #discussions channel of the Discord. He'll ask for you the email you used to login to Bolt and will forward your info along to the right person.

@Habartru
Copy link

Guys! What have you done!? Why did the bolt become so blunt??? Now he doesn't ask me several times if I want to continue, if I'm ready, if I agree... What is it? Each such answer of mine, consisting of 2 words, burns 200,000 tokens. Why is that? Today is just a terrible day. I burned 20,000,000 tokens and didn't make any progress. He constantly forgets what he is doing, rewrites the same files several times, even if you tell him that you need some other edits... Well, what is it? What should I do about it?!?

@everspader
Copy link

Each such answer of mine, consisting of 2 words, burns 200,000 tokens

I thought this was happening to me only. I managed to but 10 Million tokens in one day just we some changes to a project. Every little change was 200k tokens regardless if I explicitly prompted Bolt to only show me the changes.

@ifemuyiwaojo
Copy link

ifemuyiwaojo commented Nov 22, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests