SQLFrame: Add basic and all-types examples

[amotl]

About

Adding an example using a convenient wrapper augmentation library around Apache Spark, that computes on the database instead of on a Spark cluster.

SQLFrame implements the PySpark DataFrame API in order to enable running transformation pipelines directly on database engines - no Spark clusters or dependencies required. It is based on SQLGlot and others.

References

• https://github.com/crate/product/issues/32
• Ibis: Dataframe computing with pushdown operations to CrateDB crate-clients-tools#108
• SQLGlot crate-clients-tools#242

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch sqlframe

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}