Skip to content

Include tests in CI for Experimental Datasets #1212

@ravi-kumar-pilla

Description

@ravi-kumar-pilla

Description

Our CI tests does not include experimental datasets. Below is what runs in CI -

dataset-tests: dataset-doctests
	cd kedro-datasets && pytest tests --cov-config pyproject.toml --numprocesses 4 --dist loadfile --ignore tests/tensorflow --ignore tests/databricks
	cd kedro-datasets && pytest tests/tensorflow/test_tensorflow_model_dataset.py --no-cov
	cd kedro-datasets && pytest tests/databricks --no-cov

Our experimental dataset tests live here - kedro-datasets/kedro_datasets_experimental/tests

Context

This will make sure pytests for experimental datasets run and improve our testing phase

Possible Implementation

Include experimental dataset pytest without coverage. Update Make file command as below -

dataset-tests: dataset-doctests
	cd kedro-datasets && pytest tests --cov-config pyproject.toml --numprocesses 4 --dist loadfile --ignore tests/tensorflow --ignore tests/databricks
	cd kedro-datasets && pytest tests/tensorflow/test_tensorflow_model_dataset.py --no-cov
	cd kedro-datasets && pytest tests/databricks --no-cov
    cd kedro-datasets/kedro_datasets_experimental && pytest tests --no-cov

Possible Alternatives

NA

Metadata

Metadata

Labels

Type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions