Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HTTP Request: Text size is too large, max size is 0.1MB #4068

Closed
3 of 4 tasks
alexknows opened this issue May 3, 2024 · 6 comments
Closed
3 of 4 tasks

HTTP Request: Text size is too large, max size is 0.1MB #4068

alexknows opened this issue May 3, 2024 · 6 comments
Assignees
Labels
💪 enhancement New feature or request

Comments

@alexknows
Copy link

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • Pleas do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

I need to be able to make an http request (using the HTTP Request node) and the JSON body I need to pass exceeds 0.1MB. Is there a way around this limitation? Why is the JSON body max size only 0.1MB?

Core feature: we are generating JSON objects and we need to POST this in the body to an external database.

image

2. Describe the feature you'd like to see

The http node should be able to work with JSON body that exceed 0.1 MB.

3. How will this feature improve your workflow or experience?

Most of the endpoints we need to call their JSON body exceeds 0.1 MB.

4. Additional context or comments

No response

5. Can you help us with this feature?

  • I am interested in contributing to this feature.
@dosubot dosubot bot added the 💪 enhancement New feature or request label May 3, 2024
@Yeuoly
Copy link
Collaborator

Yeuoly commented May 4, 2024

We limit it to 0.1MB by default to avoid malicious resource consumption, as you know, all of the data will be stored into our database, and for now, there are about 30~50GB increment of storage in our SaaS service, too much space to be wasted is not our expectation, but you can break the limitation if you are self-deploying Dify, just refer to core.workflow.nodes.http_request.http_executor.py

@alexknows
Copy link
Author

Thank you!

@qianlifeng
Copy link

Please expose the config for docker deploy instead of hard code in the source code. 😄

@Yeuoly
Copy link
Collaborator

Yeuoly commented May 7, 2024

it has been fixed #4137

@Yeuoly Yeuoly closed this as completed May 7, 2024
@qianlifeng
Copy link

Good job.

@chalitguza
Copy link

chalitguza commented May 9, 2024

it has been fixed #4137
@Yeuoly

[google] Server Unavailable Error, 504 Deadline Exceeded

image

It seems there is an issue; please check. When I use the Model Gemini-1.5-pro and the data I input into the prompt system is large, and when I begin to test debug, I receive the error message shown in the picture.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💪 enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants