Open
Description
Hello, attempt to use ProcessPoolExecutor leads to
...
File "/Users/baidinkn/my-service/my_service/app.py", line 133, in my_endpoint
loop.run_in_executor(pool, long_fun)
File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/base_events.py", line 826, in run_in_executor
executor.submit(func, *args), loop=self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/concurrent/futures/process.py", line 782, in submit
self._adjust_process_count()
File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/concurrent/futures/process.py", line 741, in _adjust_process_count
self._spawn_process()
File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/concurrent/futures/process.py", line 759, in _spawn_process
p.start()
File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/process.py", line 118, in start
assert not _current_process._config.get('daemon'), \
AssertionError: daemonic processes are not allowed to have children
ThreadPoolExecutor could work here, but it doesn't suit me, because I have a CPU-bound heavy function, so it must be a separate process instead of a thread.
Example of application:
pool = ProcessPoolExecutor()
def create_app() -> Quart:
app = Quart(__name__)
app.config.from_object(settings.quart)
@security_scheme([])
@app.route("/my_endpoint")
async def my_endpoint() -> ResponseReturnValue:
loop = asyncio.get_running_loop()
loop.run_in_executor(pool, long_fun)
return "Done"
def long_fun():
time.sleep(4)hypercorn dbt_service/asgi:appIs there a way to use ProcessPoolExecutor in the web-apps served by hypercorn?
Metadata
Metadata
Assignees
Labels
No labels