feat(server): refactor concurrency model and enhance task management#3257

sachaarbonel wants to merge 1 commit intoggml-org:masterggml-org/whisper.cpp:masterfrom

sachaarbonel:simple-task-queue-serversachaarbonel/whisper.cpp:simple-task-queue-serverCopy head branch name to clipboard