[go: nahoru, domu]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Documents from DataFrame #7956

Open
hiwaveSupport opened this issue Jun 28, 2024 Discussed in #3873 · 2 comments
Open

Documents from DataFrame #7956

hiwaveSupport opened this issue Jun 28, 2024 Discussed in #3873 · 2 comments
Labels
type:feature New feature or request

Comments

@hiwaveSupport
Copy link

Discussed in #3873

Originally posted by stargeysir January 17, 2023
Hi team,
I am currently building a small project by myself where all text data is stored in a DataFrame, not individual documents. Is it possible to to turn rows in a DataFrame into documents as well, so I can use a PreProcessor before updating my InMemoryDocumentStore?
I have managed to write to the InMemoryDocumentStore after turning my DataFrame into a list of dictionaries, but it seems I need the Document format first if I wish to use a PreProcessor.
Thanks!
@anakin87
Copy link
Member

Currently we are not supporting this feature out of the box, but there is a community project that might be helpful for you.

https://github.com/EdAbati/dataframes-haystack

@hiwaveSupport
Copy link
Author

Currently we are not supporting this feature out of the box, but there is a community project that might be helpful for you.

https://github.com/EdAbati/dataframes-haystack

Great - worked for me.

@anakin87 anakin87 added the type:feature New feature or request label Jun 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type:feature New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiwaveSupport @anakin87