Error running custom image

[alexkreidler]

I have this code:

import modal
from server import make_server
app = modal.App("marker")

@app.function(
    image=modal.Image.from_registry("alexkreidler/marker-server:1.0.2-modal"),
    gpu=modal.gpu.A10G(count=1),
    container_idle_timeout=20,
    timeout=24 * 60 * 60,
    allow_concurrent_inputs=1000,
)
@modal.asgi_app()
def serve():
    return make_server()

But when I run it I get: Runner failed with exception: container exited successfully but never requested inputs

When I run modal shell --image alexkreidler/marker-server:1.0.2-modal it exits immediately instead of giving me an interactive shell (one time it did print root@modal:/# then exited. I can run it with --cmd 'echo hi' and that works.

My entrypoint is following the example script from the docs:

#!/usr/bin/env bash

exec "$@"

Do I need to add something else? Like CMD ["uvicorn", "src.server:app", "--host", "0.0.0.0", "--port", "8000"]

Shouldn't modal be "passing in" the right command to run, whether for the shell or to run a python function?

My full code with dockerfiles, entrypoint, etc is here

[mwaskom]

Hi, what does make_server do? Just naively based on the name, should you be using modal.web_server instead of modal.asgi_app?

[alexkreidler]

It returns a FastAPI app

[mwaskom]

I think you would need

ENTRYPOINT ["/app/modal-entrypoint.sh"]

rather than

ENTRYPOINT "/app/modal-entrypoint.sh"

but since it doesn't look like you're adding any custom logic in your entrypoint script, you can maybe leave that out altogether?