4.1.1 Environment

Back to Master

Runtime Information

NameValue
Java Home/opt/java/openjdk
Java Version21.0.11 (Eclipse Adoptium)
Scala Versionversion 2.13.17

Spark Properties

NameValue
spark.connect.grpc.binding.address0.0.0.0
spark.connect.grpc.binding.port15002
spark.hadoop.fs.s3a.access.key*********(redacted)
spark.hadoop.fs.s3a.endpointhttp://s3-api.norskdata.duckdns.org
spark.hadoop.fs.s3a.implorg.apache.hadoop.fs.s3a.S3AFileSystem
spark.hadoop.fs.s3a.path.style.accesstrue
spark.hadoop.fs.s3a.secret.key*********(redacted)
spark.kubernetes.container.imagedata-platform-spark:4.1.1
spark.kubernetes.namespacespark
spark.pluginsorg.apache.spark.plugins.connect.SparkConnectPlugin
spark.scheduler.mode
spark.sql.catalog.icebergorg.apache.iceberg.spark.SparkCatalog
spark.sql.catalog.iceberg.typehadoop
spark.sql.catalog.iceberg.warehouses3a://your-bucket/data
spark.sql.extensionsorg.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions

Hadoop Properties

System Properties

Metrics Properties

Classpath Entries

Environment Variables