How to setup reverse proxy with path for GenAI Text Gen and SD gradio webui?

Help
4

Thank you for promptly reply.

Yes I used chatgpt to generate Caddy script according to googled posts for Nginx, which might be necessary for Gradio I explain later.

First of all, I removed ‘unnecessary code’ and only kept the following lines:
Version 1:

my.domain.demo {
    reverse_proxy /llm* localhost:8000
    reverse_proxy /llmapi* localhost:8001
    reverse_proxy /sd* localhost:8003
}

It corrects /sd so that all 3 paths return HTTP 404 { "detail": "Not Found"} instead of no content.

I guess I have to remove the prefix like this post:
Version 2:

my.domain.demo {
	handle_path /llm* {
		reverse_proxy localhost:8000
	}

	handle_path /llmapi* {
		reverse_proxy localhost:8001
	}

	handle_path /sd* {
		reverse_proxy localhost:8003
	}
}

Results:

  1. , /llm page can be loaded but cannot displayed because resources cannot be loaded. I can see the source
    <script type="module" crossorigin src="./assets/index-a959df42.js"></script>
    Dynamically generated incorrect path
    <link rel="stylesheet" href="https://my.domain.demo/theme.css">

  2. …/llmapi/models returns Invalid HTTP request received.

  3. …/sd returns http 200 OK with no content.

I guess there must be something missing. According to the nginx conf for Gradio and another similar post on github, I should write Caddy config like:

...
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection $http_connection;
proxy_http_version 1.1;

  location / {
    proxy_set_header Host $host;
    proxy_set_header X-Forwarded-Scheme $scheme;
    proxy_set_header X-Forwarded-Proto  $scheme;
    proxy_set_header X-Forwarded-For    $remote_addr;
    proxy_set_header X-Real-IP		$remote_addr;
    proxy_pass       http://10.241.2.1:7860;

    # Force SSL
    include conf.d/include/force-ssl.conf;

    proxy_set_header Upgrade $http_upgrade;
    proxy_set_header Connection $http_connection;
    proxy_http_version 1.1;
  }

Or

    location / {
        # Serve GRADIO 7860
        proxy_pass http://localhost:7860;
        proxy_http_version 1.1;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection 'upgrade';
        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_cache_bypass $http_upgrade;
        proxy_read_timeout 86400;
        proxy_redirect off;
    }

I don’t know how to write them for Caddy so I asked ChatGPT to translate it to Caddyfile format then got the version 3 in my original post.

@matt I am not a developer using Gradio/Python/Javascript but I guess it uses websocket from the error message.