Skip to content
Merged
Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
85 commits
Select commit Hold shift + click to select a range
6623c73
rework spark in pyproject.toml
SajidAlamQB Sep 11, 2025
a424044
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Sep 22, 2025
e28b980
Update pyproject.toml
SajidAlamQB Sep 22, 2025
27f9bd3
Update spark_dataset.py
SajidAlamQB Sep 22, 2025
c82f440
Update spark_dataset.py
SajidAlamQB Sep 22, 2025
460cf31
lint
SajidAlamQB Sep 22, 2025
7514ccb
Update spark_dataset.py
SajidAlamQB Sep 22, 2025
e98ce2a
Update test_spark_dataset.py
SajidAlamQB Sep 24, 2025
f800f33
lint
SajidAlamQB Sep 24, 2025
c74ff12
revert and split sparkdataset rewrite into v2
SajidAlamQB Sep 24, 2025
5ebd4f1
Update test_spark_dataset_v2.py
SajidAlamQB Sep 24, 2025
85958f1
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Sep 25, 2025
d069256
changes based on feedback
SajidAlamQB Sep 29, 2025
fa13847
lint
SajidAlamQB Sep 29, 2025
e536bba
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Sep 30, 2025
d6b56c5
Merge branch 'main' into dev/sparkdataset-rewrite
ravi-kumar-pilla Oct 13, 2025
c05b8be
Merge branch 'main' into dev/sparkdataset-rewrite
ravi-kumar-pilla Oct 14, 2025
fe52b19
Update __init__.py
SajidAlamQB Oct 15, 2025
cc9a747
fix tests
SajidAlamQB Oct 15, 2025
8a3ddeb
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Oct 15, 2025
9906556
fix docstring and lint
SajidAlamQB Oct 15, 2025
bfecfc9
Merge branch 'dev/sparkdataset-rewrite' of https://github.com/kedro-o…
SajidAlamQB Oct 15, 2025
9a7d73f
Update spark_dataset_v2.py
SajidAlamQB Oct 15, 2025
ad18aa7
Update spark_dataset_v2.py
SajidAlamQB Oct 15, 2025
56a497d
fix unity catalog
SajidAlamQB Oct 20, 2025
bd5cb21
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Oct 20, 2025
a626476
Update spark_dataset_v2.py
SajidAlamQB Oct 20, 2025
3414371
Merge branch 'main' into dev/sparkdataset-rewrite
ravi-kumar-pilla Oct 22, 2025
144c6af
Merge branch 'dev/sparkdataset-rewrite' of https://github.com/kedro-o…
SajidAlamQB Oct 28, 2025
43e0002
Update spark_dataset_v2.py
SajidAlamQB Nov 12, 2025
d325f0b
revert
SajidAlamQB Nov 12, 2025
1fadb44
clean-up SparkDatasetV2
SajidAlamQB Nov 12, 2025
2c976ee
type check fix
SajidAlamQB Nov 12, 2025
96e7f17
Update databricks_utils.py
SajidAlamQB Nov 12, 2025
7876336
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 12, 2025
b72b4b3
remove duplicate
SajidAlamQB Nov 17, 2025
b69872d
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 17, 2025
f0a63b7
lint
SajidAlamQB Nov 17, 2025
c41727f
Delete .idea/workspace.xml
SajidAlamQB Nov 17, 2025
a3b4071
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 17, 2025
12a0ee7
Update pyproject.toml
SajidAlamQB Nov 17, 2025
8eedacf
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 20, 2025
720dc9e
changes based on review
SajidAlamQB Nov 21, 2025
1907fe9
changes based on review
SajidAlamQB Nov 26, 2025
93b57e2
fix test 1
SajidAlamQB Nov 26, 2025
86f6f17
fix test 2
SajidAlamQB Nov 26, 2025
4eeb4bc
address review comments
SajidAlamQB Nov 26, 2025
11920d8
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 26, 2025
d916461
secret fix
SajidAlamQB Nov 26, 2025
77e80e4
coverage
SajidAlamQB Nov 26, 2025
97fcf74
Update test_spark_dataset_v2.py
SajidAlamQB Nov 26, 2025
12d4566
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 26, 2025
c4fca90
add SparkDatasetV2 windows tests
SajidAlamQB Nov 26, 2025
22d2777
clean tests and coverage
SajidAlamQB Nov 26, 2025
d242580
coverage pt 2
SajidAlamQB Nov 26, 2025
3d47820
coverage
SajidAlamQB Nov 26, 2025
d0db814
skip coverage for unreachable
SajidAlamQB Nov 26, 2025
fb0f150
enable spark windows tests
SajidAlamQB Nov 27, 2025
32ce94b
windows ci test with spark 4.0.1
SajidAlamQB Nov 27, 2025
53270e3
Update unit-tests.yml
SajidAlamQB Nov 27, 2025
b1d78f5
Update unit-tests.yml
SajidAlamQB Nov 27, 2025
416ced6
use java 11
SajidAlamQB Nov 27, 2025
e19b97c
Update unit-tests.yml
SajidAlamQB Nov 27, 2025
7cecbf9
Update unit-tests.yml
SajidAlamQB Nov 27, 2025
c709ecc
please spark tests work!!
SajidAlamQB Nov 27, 2025
69f3d5c
try fix spark test 2
SajidAlamQB Nov 27, 2025
21d984e
attempt 3
SajidAlamQB Nov 27, 2025
8dc0d75
please work spark windows
SajidAlamQB Nov 27, 2025
37e8f47
Update unit-tests.yml
SajidAlamQB Nov 27, 2025
5403ec3
Update unit-tests.yml
SajidAlamQB Nov 27, 2025
639578c
spark potential fix
SajidAlamQB Nov 27, 2025
1aa7ee2
update makefile
SajidAlamQB Nov 27, 2025
d1edb53
Update conftest.py
SajidAlamQB Nov 27, 2025
94b295a
Update conftest.py
SajidAlamQB Nov 27, 2025
31b82b6
revert spark windows tests
SajidAlamQB Nov 27, 2025
c270119
Merge branch 'main' into dev/sparkdataset-rewrite
SajidAlamQB Nov 27, 2025
f11f1c1
Modify Databrics connect
DimedS Nov 28, 2025
f619efc
check if DatabricksSession is None
SajidAlamQB Dec 1, 2025
fc267d1
coverage
SajidAlamQB Dec 1, 2025
4a03e4a
Update spark_dataset_v2.py
SajidAlamQB Dec 1, 2025
0dc71a1
auto convert pandas to spark dataframe
SajidAlamQB Dec 1, 2025
a84e4d5
revert conftest
SajidAlamQB Dec 1, 2025
3af62cc
lint
SajidAlamQB Dec 1, 2025
eec8593
add docs and release notes
SajidAlamQB Dec 2, 2025
4cdbc80
pin mkdocsstrings 2.0 has breaking changes
SajidAlamQB Dec 2, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading