Skip to content

Slow recursive file split. #259

@aashis-ns

Description

@aashis-ns

split_ratio = np.array(split_ratio)
ix = np.argsort(split_ratio)
ixx = np.argsort(ix)
sm = (np.cumsum(split_ratio[ix])[:-1] * len(files)).astype(int)
split = np.split(files, sm)
for key, data_ix in zip(['train', 'validation', 'test'], ixx):
data[key] = split[data_ix].tolist()

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions