Skip to content

[RPC] Fix tuning on macOS and Windows (#15771) #16357

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jan 12, 2024
Merged

[RPC] Fix tuning on macOS and Windows (#15771) #16357

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
6e61c39
[RPC] Fix tuning on macOS and Windows (#15771)
gmeeker Jan 6, 2024
9aa2d69
[RPC] clean up _serve_loop function
gmeeker Jan 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 6 additions & 5 deletions python/tvm/rpc/server.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -119,6 +119,11 @@ def download_linked_module(file_name):
return temp


def _serve_loop(sock, load_library, work_path):
_server_env(load_library, work_path)
_ffi_api.ServerLoop(sock.fileno())


def _parse_server_opt(opts):
# parse client options
ret = {}
Expand All @@ -135,11 +140,7 @@ def _serving(sock, addr, opts, load_library):
os.chdir(work_path.path) # Avoiding file name conflict between sessions.
logger.info(f"start serving at {work_path.path}")

def _serve_loop():
_server_env(load_library, work_path)
_ffi_api.ServerLoop(sock.fileno())

server_proc = multiprocessing.Process(target=_serve_loop)
server_proc = multiprocessing.Process(target=_serve_loop, args=(sock, load_library, work_path))
server_proc.start()
server_proc.join(opts.get("timeout", None)) # Wait until finish or timeout.

Expand Down