How do i connect omniparser to a program of mine

[techsparkling]

Is there any kind of free/paid api i could use to build with omniparser? Please help me out on this one.

[Kolaposki]

You can use with gradio, check out.

pip install gradio_client

from gradio_client import Client, handle_file

client = Client("microsoft/OmniParser")
result = client.predict(
image_input=handle_file('https://raw.githubusercontent.com/gradio-app/gradio/main/test/test_files/bus.png'),
box_threshold=0.05,
iou_threshold=0.1,
api_name="/process"
)
print(result)

https://huggingface.co/spaces/microsoft/OmniParser

[yadong-lu]

Hi @techsparkling, yes, as @Kolaposki points out, you can try to use gradio client for hosting an api. We currently only have a HF demo, but don't have an existing public API.

[techsparkling]

Is there anyway to host omniparser in cloude and make use of it? The hugging face one doesnt work for me it results in an error related to preconfig json.

[abrichr]

@techsparkling please see #52.

Feedback welcome! 🙏

[techsparkling]

@abrichr Hi, i am having issues with using ec2 for omniparser, could you please help?

[abrichr]

@techsparkling what is the issue? Were you able to follow the instructions at the top of deploy.py?

[techsparkling]

@abrichr Hello sir, thanks for replying

botocore.exceptions.ClientError: An error occurred (VcpuLimitExceeded) when calling the RunInstances operation: You have requested more vCPU capacity than your current vCPU limit of 0 allows for the instance bucket that the specified instance type belongs to. Please visit http://aws.amazon.com/contact-us/ec2-request to request an adjustment to this limit. I have asked aws for an increase in the capacity. Just wanted to also is there any other way to host this and the running cost in doing that. Thanks

[Kolaposki]

You can host on Fly.io easily using a Dockerfile found in this repo.

https://github.com/addy999/omniparser-api

[techsparkling]

You can host on Fly.io easily using a Dockerfile found in this repo.

https://github.com/addy999/omniparser-api

Wow thanks. Is there any documentation or tutorial i could follow to get this done?

[techsparkling]

@Kolaposki Thanks a lot, it would be great if you could help me resolve this problem.

Failed: failed to wait for VM 080e47df539908 in started state: not_found: machine not found

Error: failed to wait for VM.... in started state: not_found: machine not found (Request ID: ....) (Trace ID:....)

When i run fly logs:

2024-11-27T16:53:46Z runner[...] [error]Not enough space to unpack image, possibly exceeds maximum of 8GB uncompressed

[techsparkling]

@abrichr Could you help me out on this one #99