Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Amazon Bedrock Knowledge Bases now processes multimodal data #626

Open
1 of 2 tasks
fsatsuki opened this issue Dec 5, 2024 · 0 comments
Open
1 of 2 tasks
Labels
roadmap Determined to be implemented

Comments

@fsatsuki
Copy link
Contributor

fsatsuki commented Dec 5, 2024

Describe the solution you'd like

Support Amazon Bedrock Knowledge Bases now processes multimodal data
https://aws.amazon.com/jp/about-aws/whats-new/2024/12/amazon-bedrock-knowledge-bases-processes-multimodal-data/

Why the solution needed

It will be able to generate answers with high accuracy from PDFs containing tables, etc. that it have not been good at until now.
When a PDF is vectorized, an image for each PDF page is stored in S3, and the S3 URI of the text extracted from the image and the S3 URI of the image are stored in a vector DB as a set.
If the search results in text extracted from the image, the text and image are passed together to LLM for an answer.
By handing over not only text but also images to the LLM, it is possible to respond with high accuracy even with complicated tables.

Additional context

Add any other context or screenshots about the feature request here.

Implementation feasibility

Are you willing to collaborate with us to discuss the solution, decide on the approach, and assist with the implementation?

  • Yes, I am able to implement the feature and create a pull request.
  • No, I am unable to implement the feature, but I am open to discussing the solution.
@statefb statefb added the roadmap Determined to be implemented label Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
roadmap Determined to be implemented
Projects
None yet
Development

No branches or pull requests

2 participants