Support metadata write like source for knowledge base

[LeoQuote]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• Pleas do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

I'm using dify knowledge base, all of the document is imported from ouside tools like github wiki, dify has reference in the dialog, but what I prefer is a link to the source, which can make the document more accessable, people can edit the document directly if there's anything wrong.

2. Describe the feature you'd like to see

When importing documents, users should be able to provide additional fields like source, link, and when providing info using particular documents , if the source, link exists, return users with these info, so they can view the original document or edit them.

3. How will this feature improve your workflow or experience?

already described above.

4. Additional context or comments

No response

5. Can you help us with this feature?

• I am interested in contributing to this feature.

[dosubot[bot]]

It seems like you've got this under control, if you want help or have specific questions, let me know what I can do for you!

About Dosu

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

[JohnJyong]

@VincePotato

[chdid]

I need this too. Thank you.
Ideas:
In the metadata of a "web page" resource, we can enter the URL. This URL could be used to open the resource in a new tab.
By providing metadata via API, we automate links to resources.

[Soabbar]

I am hesitating to open a new tickets about that, are we talking about Metadata?
As for now, while doing retrieval, the metadata are completely ignored, I thought they would play a nice role while retrieving content, but it seems not.
E.g. Document -> Creation date 2018
Search about document related to that year, can't find anything

Or my thinking is wrong? What are the use of Metadata?

[jamie0725]

Source URLs are very important for customer support bots, right now we can provide the information in Dify's frontend via metadata, but they do not seem to be used in retrieval and generation... Could you please support this feature, thanks!!

[Soabbar]

Yes exactly, they are not used during retrieval, is that a specific use case not good for Semantic search?

[patryk20120]

I believe metadata entry by API is in development.

[jamie0725]

how about carrying metadata in LLM's prompt during generation?

[patryk20120]

This I have no idea. Maybe someone from the team will answer this.