Databricks provides a community edition for free and can be used to explore it's capabilities or can be used for trying out on its Notebooks. Both Python and scala are supported.
Filesystem: It's filesystem is called dbfs
df.write.partitionBy("Location").mode("overwrite").parquet("Table1")
To View the files written and is similar as HDFS/S3/gs in GCP,
dbutils.fs.ls("/Table1/")
No comments:
Post a Comment