fsspec-union

Union handling for fsspec filesystems

Overview

This library allows for efficient layering of fsspec filesystems as a read-through cache via a chained fsspec filesystem union::.

Layer two paths, reading and writing files from/to the first satisfying location in /path/one, /path/two.

fs = open("union::dir::file:///path/one/::dir::file:///path/two/")

Importing Python modules from the first satisfying S3 location, via fsspec-python:

fs = open("python::union::s3://module/set/one::s3://module/set/two)

import module_from_set_one
import module_from_set_two
import shared_module # reads from s3://module/set/one

Note

This library was generated using copier from the Base Python Project Template repository.