Skip to content

PyTorch Compatibility: add Fork safety #145

@alxmrs

Description

@alxmrs

DataFusion's tokio runtime panics after fork(). This is a fundamental issue for PyTorch DataLoader usage. A close()/shutdown() method on XarrayContext that cleanly tears down the runtime (so it can be recreated in child processes) would help. Or a is_valid() check.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions